00000001:02000400:0.0F:1783141602.893912:0:2962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1783141619.731923:0:3181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1783141621.646493:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 563 MB/s 00000001:01000000:0.0:1783141621.896697:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 563 MB/s 00000001:01000000:2.0F:1783141622.146547:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3647 MB/s 00000020:02000000:2.0:1783141622.924036:0:3273:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_86_gcbe30f7 00000400:02000000:2.0:1783141623.839684:0:3288:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.127@tcp [8/256/0/180] 00008000:02000000:1.0:1783141627.430209:0:3438:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1783141673.446276:0:5239:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783141681.781547:0:5768:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783141681.781552:0:5768:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783141681.781675:0:5768:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000009953ee4 00000080:02000400:3.0:1783141681.781685:0:5768:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1783141681.787650:0:5768:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1783141681.787663:0:5768:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783141681.787701:0:5768:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000616af827) 00000020:00000080:3.0:1783141681.787719:0:5768:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783141681.809449:0:5768:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783141681.810362:0:5768:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783141681.857761:0:5768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783141681.857798:0:5768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783141681.857817:0:5768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783141681.857984:0:5768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783141681.858082:0:5768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783141681.858672:0:5768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783141681.858680:0:5768:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783141681.858688:0:5768:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da89837d 00000020:01000004:3.0:1783141681.858696:0:5768:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1783141681.858700:0:5768:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783141681.858704:0:5768:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000009953ee4 from MGS 00000020:01000004:3.0:1783141681.858708:0:5768:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783141681.858717:0:5768:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005c76a7e0) 00000020:00000080:3.0:1783141681.858726:0:5768:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783141681.858786:0:5768:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000009953ee4 from MGS, refs=2 00080000:01000000:3.0:1783141681.858791:0:5768:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783141681.858797:0:5768:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da89838b 00000100:00100000:3.0:1783141681.859218:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783141681.859331:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783141681.859336:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783141681.866498:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783141681.866512:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783141681.868629:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783141681.869008:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783141681.869015:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783141681.869865:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783141681.869874:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783141681.870275:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783141681.870281:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783141681.872261:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141681.872267:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141681.872268:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141681.873266:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141681.873270:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141681.873272:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141681.874190:0:5768:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783141681.878456:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1783141682.123506:0:5768:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3095 MB/s 00000001:01000000:2.0:1783141682.373730:0:5768:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3847 MB/s 00000001:01000000:3.0:1783141682.624361:0:5768:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 675 MB/s 00000001:01000000:2.0:1783141682.877863:0:5768:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 673 MB/s 00080000:10000000:2.0:1783141682.893840:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1783141682.908981:0:5768:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1783141682.909008:0:5768:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783141682.909010:0:5768:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:2.0:1783141682.909227:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783141682.910200:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783141682.910286:0:5768:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783141682.910326:0:5768:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1783141682.910564:0:5768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1783141682.910596:0:5768:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783141682.910873:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141682.910987:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783141682.910999:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783141682.911566:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783141682.911572:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783141682.915686:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783141682.915698:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783141682.916256:0:5768:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783141682.916277:0:5768:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.127@tcp' 00000020:01000004:2.0:1783141682.916279:0:5768:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783141682.916319:0:5768:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.127@tcp (typ=mgc) 00000020:00000080:2.0:1783141682.916339:0:5768:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.127@tcp (00000000748b1229) 00000020:00000080:2.0:1783141682.916354:0:5768:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783141682.916445:0:5768:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003f74462c@MGC192.168.203.127@tcp: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1783141682.916630:0:5768:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.127@tcp-0 is initialized 00000040:01000000:2.0:1783141682.916636:0:5768:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 1 is initialized 00000100:00080000:3.0:1783141682.917035:0:5783:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1783141682.923700:0:5784:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783141682.925192:0:5768:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.127@tcp (uuid 872ec41a-f648-467b-b036-39669ac398c4) 00000020:00000080:3.0:1783141682.925215:0:5768:0:(genops.c:1406:class_connect()) connect: client 872ec41a-f648-467b-b036-39669ac398c4, cookie 0x279ffa91da898399 00000100:00080000:3.0:1783141682.925227:0:5768:0:(import.c:512:import_select_connection()) MGC192.168.203.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783141682.925231:0:5768:0:(import.c:626:import_select_connection()) MGC192.168.203.127@tcp: import 000000003f74462c using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1783141682.925271:0:5768:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000041abbad9 x1869759510478976/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783141682.925362:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000041abbad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:872ec41a-f648-467b-b036-39669ac398c4:3304:1869759510478976:0@lo:250: 00000100:00100000:3.0:1783141682.925428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783141682.925493:0:5768:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 872ec41a-f648-467b-b036-39669ac398c4->MGS 00000020:01000004:3.0:1783141682.925508:0:5768:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783141682.925526:0:5768:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783141682.925540:0:5768:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c8d1b9cc) 00000020:00000080:3.0:1783141682.925551:0:5768:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783141682.926987:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510478976 00000100:00100000:2.0:1783141682.926998:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510478976 00000100:00100000:2.0:1783141682.927032:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141682.927044:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079ec9a2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1869759510478976:12345-0@lo:250: 00010000:00080000:2.0:1783141682.927068:0:5779:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 872ec41a-f648-467b-b036-39669ac398c4@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1783141682.927089:0:5779:0:(genops.c:1406:class_connect()) connect: client 872ec41a-f648-467b-b036-39669ac398c4, cookie 0x279ffa91da8983a7 00000100:00080000:2.0:1783141682.927199:0:5779:0:(import.c:65:import_set_state_nolock()) 0000000007369a0d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141682.927256:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079ec9a2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+5:3304:x1869759510478976:12345-0@lo:250: Request processed in 211us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141682.927263:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141682.927443:0:3304:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783141682.927452:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.127@tcp: connect to target with instance 0 00000100:00080000:2.0:1783141682.927478:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783141682.927483:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783141682.927486:0:3304:0:(import.c:65:import_set_state_nolock()) 000000003f74462c MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783141682.927489:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783141682.927496:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783141682.927501:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000041abbad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:872ec41a-f648-467b-b036-39669ac398c4:3304:1869759510478976:0@lo:250: 00000100:00100000:3.0:1783141682.944102:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141682.944298:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783141682.944305:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783141682.949623:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783141682.949639:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783141682.950639:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783141682.950649:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783141682.953514:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141682.953681:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783141682.953687:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783141682.954228:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783141682.954241:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783141683.006769:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783141683.006958:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783141683.006964:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783141683.015006:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783141683.015026:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783141683.016026:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141683.016285:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783141683.016292:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783141683.018581:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783141683.018604:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783141683.019455:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141683.019699:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783141683.019705:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783141683.020329:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783141683.020337:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783141683.022325:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141683.022645:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783141683.022652:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783141683.023330:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783141683.023337:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783141683.069192:0:5768:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141683.069372:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783141683.069378:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783141683.073492:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783141683.073506:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783141683.079332:0:5768:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783141683.079348:0:5768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783141683.082278:0:5768:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783141683.082304:0:5768:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1783141683.082310:0:5768:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783141683.082453:0:5768:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783141683.082522:0:5768:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.127@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1783141683.082527:0:5768:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783141683.082528:0:5768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783141683.082530:0:5768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141683.082531:0:5768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783141683.082532:0:5768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141683.082533:0:5768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141683.082535:0:5768:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783141683.082536:0:5768:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783141683.082538:0:5768:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783141683.082539:0:5768:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783141683.082540:0:5768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141683.082542:0:5768:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783141683.082544:0:5768:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1783141683.082546:0:5768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783141683.082547:0:5768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783141683.082548:0:5768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141683.082549:0:5768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783141683.082550:0:5768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141683.082552:0:5768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141683.082553:0:5768:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783141683.082558:0:5768:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783141683.082559:0:5768:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783141683.082560:0:5768:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783141683.082561:0:5768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141683.082562:0:5768:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783141683.082606:0:5768:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783141683.082625:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000015ad13a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479104:0@lo:253: 00000100:00100000:1.0:1783141683.082709:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141683.082764:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 000000002ba2d2cb going to sleep for 11 seconds 00000100:00100000:2.0:1783141683.083100:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510479104 00000100:00100000:2.0:1783141683.083108:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510479104 00000100:00100000:2.0:1783141683.083162:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141683.083169:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c134fb39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+5:5768:x1869759510479104:12345-0@lo:253: 20000000:01000000:2.0:1783141683.083547:0:5782:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783141683.083551:0:5782:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1783141683.084572:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783141683.084662:0:5782:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1783141683.085204:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141683.091080:0:5803:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1783141683.091396:0:5782:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783141683.091401:0:5782:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1783141683.091407:0:5782:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1783141683.091409:0:5782:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1783141683.091424:0:5782:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1783141683.091682:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141683.091921:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1783141683.091933:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783141683.091984:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1783141683.092038:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1783141683.092154:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1783141683.092246:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1783141683.092255:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1783141683.092302:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1783141683.092311:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1783141683.092346:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1783141683.092353:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1783141683.092383:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1783141683.092449:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1783141683.092513:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783141683.092518:0:5782:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1783141683.092530:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141683.092749:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1783141683.092760:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783141683.092795:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1783141683.092844:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1783141683.092888:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1783141683.092900:0:5782:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1783141683.092974:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1783141683.092983:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1783141683.093030:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1783141683.096540:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1783141683.096615:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1783141683.096636:0:5782:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1783141683.096836:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1783141683.096848:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1783141683.096884:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1783141683.096920:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1783141683.097108:0:5782:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1783141683.097163:0:5782:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1783141683.097171:0:5782:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1783141683.097830:0:5804:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1783141683.098111:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1783141683.098132:0:5782:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.127@tcp for mdt 20000000:01000000:3.0:1783141683.098135:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:3.0:1783141683.098170:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1783141683.098177:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1783141683.098204:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1783141683.098210:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:3.0:1783141683.098275:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1783141683.098284:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1783141683.098317:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1783141683.098353:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1783141683.098520:0:5782:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783141683.098524:0:5782:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783141683.098529:0:5782:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1783141683.098534:0:5782:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1783141683.099361:0:5805:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1783141683.099492:0:5782:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1783141683.112387:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1783141683.112438:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1783141683.113536:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1783141683.113561:0:5782:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783141683.113563:0:5782:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783141683.113567:0:5782:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783141683.113603:0:5782:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783141683.113606:0:5782:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1783141683.113639:0:5782:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783141683.113641:0:5782:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783141683.116717:0:5806:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1783141683.117336:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1783141683.117383:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1783141683.117457:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1783141683.117519:0:5782:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783141683.117521:0:5782:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783141683.118776:0:5807:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1783141683.119704:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1783141683.119751:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1783141683.119788:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1783141683.119803:0:5782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783141683.119805:0:5782:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1783141683.119812:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783141683.119832:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120126:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120136:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120143:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120148:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120155:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120161:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007090a5ea already unused, calling callback (000000001d5b734d) 00010000:00010000:0.0:1783141683.120164:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120172:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120184:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120191:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.120196:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007090a5ea/0x279ffa91da8983ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783141683.120227:0:5782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783141683.361288:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c134fb39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+5:5768:x1869759510479104:12345-0@lo:253: Request processed in 278111us (278571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141683.361307:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141683.361414:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000015ad13a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479104:0@lo:253: 10000000:01000000:3.0:1783141683.361429:0:5768:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783141683.361432:0:5768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783141683.361434:0:5768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141683.361435:0:5768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141683.361436:0:5768:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1783141683.361438:0:5768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141683.361453:0:5768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141683.361454:0:5768:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141683.361455:0:5768:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141683.361456:0:5768:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783141683.361589:0:5768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141683.361591:0:5768:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783141683.361611:0:5768:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000009953ee4 from lustre-MDT0000 10000000:01000000:3.0:1783141683.361637:0:5768:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783141683.361639:0:5768:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783141683.361643:0:5768:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff946482f299c0 10000000:01000000:3.0:1783141683.361647:0:5768:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783141683.361654:0:5768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff946482f299c0 from 1 10000000:01000000:3.0:1783141683.361656:0:5768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783141683.361692:0:5768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.361702:0:5768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.361710:0:5768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141683.361728:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479232:0@lo:101: 00000100:00100000:3.0:1783141683.361765:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.361820:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eeee862b going to sleep for 11 seconds 00000100:00100000:0.0:1783141683.361887:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510479232 00000100:00100000:0.0:1783141683.361894:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510479232 00000100:00100000:0.0:1783141683.361943:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141683.361951:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000008de3f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+5:5768:x1869759510479232:12345-0@lo:101: 00010000:00010000:0.0:1783141683.361965:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141683.361976:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8983b5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.361998:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8983b5 expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.362007:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8983b5 expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.362016:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007090a5ea, rc 0) 00000100:00100000:0.0:1783141683.362071:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000008de3f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+6:5768:x1869759510479232:12345-0@lo:101: Request processed in 121us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141683.362077:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141683.362152:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479232:0@lo:101: 00010000:00010000:3.0:1783141683.362163:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.362170:0:5768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141683.362220:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479360:0@lo:501: 00000100:00100000:3.0:1783141683.362242:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.362301:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eeee862b going to sleep for 11 seconds 00000100:00100000:0.0:1783141683.362426:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510479360 00000100:00100000:0.0:1783141683.362431:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510479360 00000100:00100000:0.0:1783141683.362476:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141683.362741:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4dc5116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+6:5768:x1869759510479360:12345-0@lo:501: 00000100:00100000:0.0:1783141683.363017:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4dc5116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+6:5768:x1869759510479360:12345-0@lo:501: Request processed in 535us (773us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141683.363025:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141683.363126:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479360:0@lo:501: 10000000:01000000:3.0:1783141683.363151:0:5768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783141683.363208:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.363217:0:5768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141683.363225:0:5768:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946489ce7800 10000000:01000000:3.0:1783141683.363230:0:5768:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783141683.363234:0:5768:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff946489ce7800 10000000:01000000:3.0:1783141683.363236:0:5768:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783141683.363238:0:5768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff946489ce7800 from 1 10000000:01000000:3.0:1783141683.363241:0:5768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783141683.363259:0:5768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000000aa053a9/0x279ffa91da8983c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.363266:0:5768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 000000000aa053a9/0x279ffa91da8983c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.363274:0:5768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000000aa053a9/0x279ffa91da8983c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141683.363287:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479488:0@lo:101: 00000100:00100000:3.0:1783141683.363325:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.363360:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eeee862b going to sleep for 11 seconds 00000100:00100000:2.0:1783141683.363422:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510479488 00000100:00100000:2.0:1783141683.363427:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510479488 00000100:00100000:2.0:1783141683.363479:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141683.363614:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ed8bb99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+6:5768:x1869759510479488:12345-0@lo:101: 00010000:00010000:2.0:1783141683.363624:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141683.363636:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019461d9a/0x279ffa91da8983ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8983c3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141683.363666:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019461d9a/0x279ffa91da8983ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8983c3 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141683.363674:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019461d9a/0x279ffa91da8983ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8983c3 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141683.363681:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019461d9a, rc 0) 00000100:00100000:2.0:1783141683.363723:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ed8bb99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+7:5768:x1869759510479488:12345-0@lo:101: Request processed in 113us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141683.363730:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783141683.363809:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479488:0@lo:101: 00010000:00010000:3.0:1783141683.363820:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000000aa053a9/0x279ffa91da8983c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.363828:0:5768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000000aa053a9/0x279ffa91da8983c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141683.363840:0:5768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783141683.363947:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000000aa053a9/0x279ffa91da8983c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.363954:0:5768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 000000000aa053a9/0x279ffa91da8983c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141683.363960:0:5768:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783141683.363965:0:5768:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783141683.363969:0:5768:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff946489ce7800 10000000:01000000:3.0:1783141683.363971:0:5768:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783141683.363973:0:5768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783141683.363975:0:5768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783141683.363987:0:5768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.363993:0:5768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.363999:0:5768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141683.364016:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479616:0@lo:101: 00000100:00100000:3.0:1783141683.364041:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.364066:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eeee862b going to sleep for 11 seconds 00000100:00100000:1.0:1783141683.364120:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510479616 00000100:00100000:1.0:1783141683.364125:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510479616 00000100:00100000:1.0:1783141683.364169:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783141683.364175:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb3ca1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+7:5768:x1869759510479616:12345-0@lo:101: 00010000:00010000:1.0:1783141683.364182:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141683.364190:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8983d1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141683.364202:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8983d1 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141683.364209:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8983d1 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141683.364215:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065bc03ab, rc 0) 00000100:00100000:1.0:1783141683.364249:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb3ca1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+8:5768:x1869759510479616:12345-0@lo:101: Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141683.364264:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783141683.364374:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479616:0@lo:101: 00010000:00010000:3.0:1783141683.364384:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.364391:0:5768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141683.364429:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479744:0@lo:501: 00000100:00100000:3.0:1783141683.364453:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.364612:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eeee862b going to sleep for 11 seconds 00000100:00100000:2.0:1783141683.364680:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510479744 00000100:00100000:2.0:1783141683.364685:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510479744 00000100:00100000:2.0:1783141683.364752:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783141683.364759:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b91ecd47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+8:5768:x1869759510479744:12345-0@lo:501: 00000100:00100000:2.0:1783141683.364962:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b91ecd47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+9:5768:x1869759510479744:12345-0@lo:501: Request processed in 203us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141683.364969:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141683.365060:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479744:0@lo:501: 00000100:00100000:3.0:1783141683.365086:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479872:0@lo:503: 00000100:00100000:3.0:1783141683.365121:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.365324:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eeee862b going to sleep for 11 seconds 00000100:00100000:1.0:1783141683.365392:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510479872 00000100:00100000:1.0:1783141683.365397:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510479872 00000100:00100000:1.0:1783141683.365417:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783141683.365422:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017bae26e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+9:5768:x1869759510479872:12345-0@lo:503: 00000100:00100000:1.0:1783141683.365703:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017bae26e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+9:5768:x1869759510479872:12345-0@lo:503: Request processed in 280us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141683.365709:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141683.365790:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510479872:0@lo:503: 00000100:00100000:1.0:1783141683.366107:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e633b81f pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:5810:1869759510480000:0@lo:502: 00000100:00100000:1.0:1783141683.366141:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141683.366162:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510480000 00000100:00100000:1.0:1783141683.366166:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510480000 00000100:00100000:1.0:1783141683.366183:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141683.366189:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e61958de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+9:5810:x1869759510480000:12345-0@lo:502: 00000100:00100000:1.0:1783141683.366313:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e61958de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+9:5810:x1869759510480000:12345-0@lo:502: Request processed in 123us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141683.366319:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141683.366355:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set 000000004aa575f7 going to sleep for 11 seconds 00000100:00100000:1.0:1783141683.366366:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e633b81f pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:5810:1869759510480000:0@lo:502: 00000020:01000000:1.0:1783141683.366385:0:5810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141683.366395:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141683.366397:0:5810:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783141683.366401:0:5810:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783141683.366403:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783141683.366421:0:5810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b0f065bf) 00000020:00000080:1.0:1783141683.366442:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783141683.366448:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783141683.366763:0:5810:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783141683.366770:0:5810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da8983e6 00000020:00000080:1.0:1783141683.366968:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783141683.366974:0:5810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141683.366978:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141683.366979:0:5810:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783141683.366981:0:5810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141683.366984:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141683.366985:0:5810:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783141683.366988:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783141683.366994:0:5810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b2f24305) 00000020:00000080:1.0:1783141683.367003:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783141683.367007:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783141683.367009:0:5810:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783141683.367011:0:5810:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783141683.367016:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783141683.367055:0:5810:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000009953ee4 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783141683.367064:0:5810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000019aceccc) 00000020:00000080:1.0:1783141683.367071:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783141683.367113:0:5810:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783141683.367128:0:5810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da8983fb 00000020:00000080:1.0:1783141683.367222:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783141683.367228:0:5810:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783141683.367233:0:5810:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x279ffa91da898402 00080000:01000000:1.0:1783141683.367237:0:5810:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783141683.367241:0:5810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da898409 00080000:10000000:1.0:1783141683.367730:0:5810:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1783141683.367941:0:5810:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1783141683.371764:0:5810:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783141683.425444:0:5810:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783141683.425808:0:5810:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783141683.427983:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783141683.428187:0:5810:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783141683.458973:0:5810:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000084992e62) 00000020:00000080:2.0:1783141683.458993:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783141683.459063:0:5810:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783141683.459070:0:5810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da898417 00000020:00000080:2.0:1783141683.459530:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1783141683.461088:0:5810:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141683.489165:0:5810:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141683.513766:0:5810:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141683.552410:0:5810:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141683.580012:0:5810:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141683.607247:0:5810:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1783141683.634455:0:5810:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x279ffa91da89841e 00000020:00000080:3.0:1783141683.634855:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783141683.634864:0:5810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141683.634868:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141683.634870:0:5810:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783141683.634872:0:5810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141683.634876:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141683.634877:0:5810:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783141683.634880:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783141683.634916:0:5810:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783141683.634927:0:5810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141683.634929:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141683.634930:0:5810:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783141683.634931:0:5810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141683.634933:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141683.634934:0:5810:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783141683.634935:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783141683.634936:0:5810:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783141683.634974:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:5810:1869759510480128:0@lo:502: 00000100:00100000:3.0:1783141683.635052:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.635140:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e430ba81 going to sleep for 11 seconds 00000100:00100000:1.0:1783141683.635230:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510480128 00000100:00100000:1.0:1783141683.635237:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510480128 00000100:00100000:1.0:1783141683.635309:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783141683.635317:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d39b985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+9:5810:x1869759510480128:12345-0@lo:502: 00000100:00100000:1.0:1783141683.635667:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d39b985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+9:5810:x1869759510480128:12345-0@lo:502: Request processed in 350us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141683.635676:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783141683.635752:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:5810:1869759510480128:0@lo:502: 00000020:01000000:3.0:1783141683.635776:0:5810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141683.635781:0:5810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141683.635782:0:5810:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783141683.635786:0:5810:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1783141683.635981:0:5768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1783141683.636005:0:5768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783141683.636023:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.636033:0:5768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141683.636041:0:5768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff946489ce7800 from 1 10000000:01000000:0.0:1783141683.636044:0:5768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783141683.636078:0:5768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.636086:0:5768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.636095:0:5768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141683.636107:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000524d80ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480256:0@lo:101: 00000100:00100000:0.0:1783141683.636136:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141683.636735:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000dd7422bb going to sleep for 11 seconds 00000100:00100000:2.0:1783141683.636805:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510480256 00000100:00100000:2.0:1783141683.636817:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510480256 00000100:00100000:2.0:1783141683.636842:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783141683.636848:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7e16693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+9:5768:x1869759510480256:12345-0@lo:101: 00010000:00010000:2.0:1783141683.636858:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141683.636868:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898425 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141683.636888:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898425 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141683.636897:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898425 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141683.636904:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e1fa944, rc 0) 00000100:00100000:2.0:1783141683.636942:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7e16693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+10:5768:x1869759510480256:12345-0@lo:101: Request processed in 94us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141683.636949:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783141683.637022:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000524d80ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480256:0@lo:101: 00010000:00010000:0.0:1783141683.637034:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.637043:0:5768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141683.637674:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000524d80ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480384:0@lo:256: 00000100:00100000:0.0:1783141683.637717:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141683.637740:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000dd7422bb going to sleep for 11 seconds 00000100:00100000:2.0:1783141683.637803:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510480384 00000100:00100000:2.0:1783141683.637807:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510480384 00000100:00100000:2.0:1783141683.637826:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141683.637831:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1fad2b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+10:5768:x1869759510480384:12345-0@lo:256: 20000000:01000000:2.0:1783141683.637846:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783141683.637850:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783141683.637914:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1fad2b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+10:5768:x1869759510480384:12345-0@lo:256: Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141683.637920:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783141683.637992:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000524d80ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480384:0@lo:256: 10000000:01000000:0.0:1783141683.638736:0:5768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783141683.638792:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.638802:0:5768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141683.638914:0:5768:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946489ce7800 from 1 10000000:01000000:1.0:1783141683.638918:0:5768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141683.638945:0:5768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141683.638953:0:5768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141683.638961:0:5768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141683.638975:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e633b81f pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480512:0@lo:101: 00000100:00100000:1.0:1783141683.639008:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141683.639041:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000aa1a5c79 going to sleep for 11 seconds 00000100:00100000:0.0:1783141683.639094:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510480512 00000100:00100000:0.0:1783141683.639100:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510480512 00000100:00100000:0.0:1783141683.639133:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783141683.639140:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000071a2cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+10:5768:x1869759510480512:12345-0@lo:101: 00010000:00010000:0.0:1783141683.639149:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141683.639160:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898433 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.639178:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898433 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.639185:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898433 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.639191:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000bbdc4a3, rc 0) 00000100:00100000:0.0:1783141683.639229:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000071a2cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:5768:x1869759510480512:12345-0@lo:101: Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141683.639234:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783141683.639311:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e633b81f pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480512:0@lo:101: 00010000:00010000:3.0:1783141683.639323:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.639330:0:5768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141683.639382:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480640:0@lo:501: 00000100:00100000:3.0:1783141683.639408:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.639427:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e430ba81 going to sleep for 11 seconds 00000100:00100000:0.0:1783141683.639591:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510480640 00000100:00100000:0.0:1783141683.639596:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510480640 00000100:00100000:0.0:1783141683.639629:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783141683.639635:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8cafb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:5768:x1869759510480640:12345-0@lo:501: 00000100:00100000:0.0:1783141683.640612:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8cafb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:5768:x1869759510480640:12345-0@lo:501: Request processed in 975us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141683.640622:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783141683.640754:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480640:0@lo:501: 00000100:00100000:3.0:1783141683.640790:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480768:0@lo:503: 00000100:00100000:3.0:1783141683.640830:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.640894:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e430ba81 going to sleep for 11 seconds 00000100:00100000:2.0:1783141683.640928:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510480768 00000100:00100000:2.0:1783141683.640934:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510480768 00000100:00100000:2.0:1783141683.640975:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783141683.640982:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcab9933 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:5768:x1869759510480768:12345-0@lo:503: 00000040:00080000:2.0:1783141683.641025:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783141683.641094:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcab9933 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:5768:x1869759510480768:12345-0@lo:503: Request processed in 113us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141683.641101:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783141683.641158:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480768:0@lo:503: 00000040:00080000:1.0:1783141683.642161:0:5814:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1783141683.642315:0:5768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1783141683.642333:0:5768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783141683.642390:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.642402:0:5768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141683.642440:0:5768:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783141683.642443:0:5768:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946489ce7800 10000000:01000000:3.0:1783141683.642446:0:5768:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946489ce7800 10000000:01000000:3.0:1783141683.642450:0:5768:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783141683.642456:0:5768:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff946489ce7800 from 1 10000000:01000000:3.0:1783141683.642694:0:5768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783141683.642721:0:5768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.642729:0:5768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.642748:0:5768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141683.642765:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480896:0@lo:101: 00000100:00100000:3.0:1783141683.642811:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.642873:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 0000000045be8c96 going to sleep for 11 seconds 00000100:00100000:0.0:1783141683.642908:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510480896 00000100:00100000:0.0:1783141683.642914:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510480896 00000100:00100000:0.0:1783141683.642983:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141683.642991:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3afdf53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:5768:x1869759510480896:12345-0@lo:101: 00010000:00010000:0.0:1783141683.643003:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141683.643013:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898441 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.643032:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898441 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.643041:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898441 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.643048:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2772b3a, rc 0) 00000100:00100000:0.0:1783141683.643085:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3afdf53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:5768:x1869759510480896:12345-0@lo:101: Request processed in 95us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141683.643092:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783141683.643151:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510480896:0@lo:101: 00010000:00010000:3.0:1783141683.643164:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.643171:0:5768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141683.643210:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510481024:0@lo:501: 00000100:00100000:3.0:1783141683.643232:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.643331:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 0000000045be8c96 going to sleep for 11 seconds 00000100:00100000:1.0:1783141683.643365:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510481024 00000100:00100000:1.0:1783141683.643369:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510481024 00000100:00100000:1.0:1783141683.643396:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783141683.643401:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c30de244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:5768:x1869759510481024:12345-0@lo:501: 00000100:00100000:1.0:1783141683.643813:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c30de244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:5768:x1869759510481024:12345-0@lo:501: Request processed in 410us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141683.643818:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783141683.643857:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510481024:0@lo:501: 00000100:00100000:3.0:1783141683.643875:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510481152:0@lo:503: 00000100:00100000:3.0:1783141683.643901:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.643924:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 0000000045be8c96 going to sleep for 11 seconds 00000100:00100000:0.0:1783141683.643932:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510481152 00000100:00100000:0.0:1783141683.643936:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510481152 00000100:00100000:0.0:1783141683.643964:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141683.643969:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099d40969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:5768:x1869759510481152:12345-0@lo:503: 00000100:00100000:0.0:1783141683.644187:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099d40969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:5768:x1869759510481152:12345-0@lo:503: Request processed in 217us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141683.644193:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783141683.644211:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510481152:0@lo:503: 00000100:00100000:2.0:1783141683.644567:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000315e0500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:5815:1869759510481280:0@lo:502: 00000100:00100000:2.0:1783141683.644611:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141683.644639:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set 00000000474d1090 going to sleep for 11 seconds 00000100:00100000:1.0:1783141683.644656:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510481280 00000100:00100000:1.0:1783141683.644661:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510481280 00000100:00100000:1.0:1783141683.644689:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783141683.644695:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6182ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:5815:x1869759510481280:12345-0@lo:502: 00000100:00100000:1.0:1783141683.644869:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6182ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:5815:x1869759510481280:12345-0@lo:502: Request processed in 174us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141683.644875:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783141683.645208:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000315e0500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:5815:1869759510481280:0@lo:502: 00000020:01000004:2.0:1783141683.645262:0:5815:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783141683.645276:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000026d78a8f) 00000020:00000080:2.0:1783141683.645295:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1783141683.645819:0:5815:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000009953ee4 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783141683.645824:0:5815:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000009953ee4 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783141683.645826:0:5815:0:(obd_mount.c:701:lustre_put_lsi()) put 0000000009953ee4 4 00010000:00080000:2.0:1783141683.645852:0:5815:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000010d67c4f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1783141683.648037:0:5815:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1783141683.648135:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783141683.648167:0:5815:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783141683.648178:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x279ffa91da898456 00000100:00080000:2.0:1783141683.648189:0:5815:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783141683.648194:0:5815:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000010d67c4f using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141683.648237:0:5815:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000315e0500 x1869759510481408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783141683.648261:0:5815:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783141683.648453:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000315e0500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510481408:0@lo:38: 00000100:00100000:0.0:1783141683.648809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141683.648897:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510481408 00000100:00100000:2.0:1783141683.648904:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510481408 00000100:00100000:2.0:1783141683.648932:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141683.648945:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000524d80ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1869759510481408:12345-0@lo:38: 00000100:00100000:2.0:1783141683.648991:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000524d80ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1869759510481408:12345-0@lo:38: Request processed in 46us (251us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783141683.648997:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141683.650496:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783141683.650507:0:3304:0:(import.c:65:import_set_state_nolock()) 0000000010d67c4f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783141683.650512:0:3304:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783141683.650516:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000315e0500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510481408:0@lo:38: 00000100:00100000:2.0:1783141683.650863:0:5815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f7a58691 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:5815:1869759510481536:0@lo:502: 00000100:00100000:2.0:1783141683.650934:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141683.650965:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510481536 00000100:00100000:2.0:1783141683.650970:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510481536 00000100:00100000:2.0:1783141683.651012:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783141683.651021:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007173e695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:5815:x1869759510481536:12345-0@lo:502: 00000100:00100000:2.0:1783141683.651231:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007173e695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:5815:x1869759510481536:12345-0@lo:502: Request processed in 210us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141683.651238:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783141683.651280:0:5815:0:(client.c:2701:ptlrpc_set_wait()) set 00000000474d1090 going to sleep for 11 seconds 00000100:00100000:2.0:1783141683.651294:0:5815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f7a58691 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:5815:1869759510481536:0@lo:502: 00000040:00080000:2.0:1783141683.651315:0:5815:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1783141683.651919:0:5768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1783141683.651939:0:5768:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783141683.651959:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.651980:0:5768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783141683.652026:0:5768:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783141683.652028:0:5768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141683.652029:0:5768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141683.652030:0:5768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141683.652032:0:5768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141683.652033:0:5768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141683.652034:0:5768:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141683.652035:0:5768:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141683.652037:0:5768:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141683.652038:0:5768:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141683.652039:0:5768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141683.652041:0:5768:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783141683.652044:0:5768:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1783141683.652047:0:5768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783141683.652048:0:5768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141683.652049:0:5768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141683.652050:0:5768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141683.652052:0:5768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141683.652053:0:5768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141683.652054:0:5768:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141683.652055:0:5768:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141683.652056:0:5768:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141683.652057:0:5768:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141683.652057:0:5768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141683.652058:0:5768:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783141683.652075:0:5768:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783141683.652086:0:5768:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510481664:0@lo:253: 00000100:00100000:3.0:1783141683.652123:0:5768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.652157:0:5768:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e430ba81 going to sleep for 11 seconds 00000100:00100000:0.0:1783141683.652207:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510481664 00000100:00100000:0.0:1783141683.652212:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510481664 00000100:00100000:0.0:1783141683.652249:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141683.652256:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005c80473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:5768:x1869759510481664:12345-0@lo:253: 20000000:01000000:0.0:1783141683.652285:0:5782:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783141683.652297:0:5782:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783141683.689956:0:5782:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783141683.689974:0:5782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783141683.690056:0:5802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783141683.690061:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783141683.690080:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.690099:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898425 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.690107:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.690157:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898425 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141683.690187:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898425 expref: 12 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141683.690200:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b391cc84 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1869759510481792:0@lo:104: 00000100:00100000:0.0:1783141683.690258:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141683.690402:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b86ed0ea going to sleep for 11 seconds 00000100:00100000:2.0:1783141683.690948:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510481792 00000100:00100000:2.0:1783141683.690956:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510481792 00000100:00100000:2.0:1783141683.691198:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141683.691207:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082362f16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:5802:x1869759510481792:12345-0@lo:104: 00010000:00010000:2.0:1783141683.691220:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141683.691887:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783141683.691895:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082362f16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:5802:x1869759510481792:12345-0@lo:104: Request processed in 689us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141683.691917:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141683.692789:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b391cc84 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1869759510481792:0@lo:104: 00010000:00010000:1.0:1783141683.692812:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.693209:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141683.693215:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.693237:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006151b17e already unused, calling callback (00000000ab8730ad) 10000000:00010000:3.0:1783141683.693240:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.693249:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141683.693594:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141683.693599:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783141683.693643:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.693649:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141683.693706:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.693713:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da898425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89842c expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.693730:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141683.693732:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141683.693734:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141683.693768:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004fbbf23d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510481920:0@lo:103: 00000100:00100000:2.0:1783141683.693824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141683.693895:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510481920 00000100:00100000:3.0:1783141683.693901:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510481920 00010000:00010000:3.0:1783141683.693923:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898425 expref: 13 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141683.693998:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141683.694012:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7a58691 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+13:3306:x1869759510481920:12345-0@lo:103: 00010000:00010000:3.0:1783141683.694024:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141683.694029:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898425 expref: 13 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694039:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898425 expref: 13 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694050:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009e1fa944/0x279ffa91da89842c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898425 expref: 13 pid: 5780 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694063:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694070:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783141683.694083:0:5772:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004022317s 00010000:00010000:3.0:1783141683.694086:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694092:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694097:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694102:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694107:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e453cf22 already unused, calling callback (000000001d5b734d) 00010000:00010000:3.0:1783141683.694116:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694122:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694135:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694145:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141683.694176:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7a58691 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+12:3306:x1869759510481920:12345-0@lo:103: Request processed in 165us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141683.694183:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141683.694341:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004fbbf23d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510481920:0@lo:103: 00010000:00010000:3.0:1783141683.694430:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694437:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141683.694443:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e453cf22/0x279ffa91da89845d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141683.696943:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005c80473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:5768:x1869759510481664:12345-0@lo:253: Request processed in 44681us (44813us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141683.696957:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783141683.697063:0:5768:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:5768:1869759510481664:0@lo:253: 10000000:01000000:3.0:1783141683.697078:0:5768:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783141683.697081:0:5768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783141683.697083:0:5768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141683.697084:0:5768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141683.697085:0:5768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141683.697086:0:5768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141683.697088:0:5768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141683.697100:0:5768:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141683.697101:0:5768:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141683.697103:0:5768:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141683.697104:0:5768:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141683.697106:0:5768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141683.697107:0:5768:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783141683.697120:0:5768:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783141683.704445:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141683.705125:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783141683.705356:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141683.706860:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783141683.707136:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141683.707315:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1783141683.708635:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141683.709030:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1783141683.709232:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141683.709402:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1783141683.710006:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141683.710210:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1783141683.762281:0:5768:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1783141683.804318:0:5768:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1783141683.804946:0:5821:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1783141683.809560:0:5820:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1783141683.809567:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783141683.812180:0:5768:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783141683.815861:0:5768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783141683.816290:0:5768:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783141683.816302:0:5768:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783141683.816551:0:5768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141683.821237:0:5768:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783141683.821973:0:5768:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783141683.822014:0:5768:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783141683.822298:0:5768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783141683.822686:0:5768:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1783141683.825034:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783141683.825167:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783141683.825293:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783141683.827123:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783141683.827291:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1783141683.830291:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783141683.832051:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783141683.832205:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783141683.832327:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783141683.833700:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783141683.835161:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783141683.835384:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783141683.835552:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783141683.835717:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783141683.835867:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783141683.836016:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783141683.836278:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783141683.836446:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783141683.836912:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783141683.837099:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783141683.837233:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783141683.837443:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783141683.837631:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783141683.838037:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783141683.838166:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783141683.838309:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783141683.838871:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783141683.839038:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783141683.839191:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1783141683.839337:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1783141683.839667:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1783141683.839990:0:5768:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1783141683.840651:0:5768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1783141683.857528:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1783141683.899225:0:5768:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783141683.899263:0:5768:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa4c301d63988 00100000:10000000:1.0:1783141683.899271:0:5768:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783141683.901546:0:5768:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783141683.901562:0:5768:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783141683.901574:0:5768:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783141683.901609:0:5768:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1783141683.935185:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783141683.959878:0:5821:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783141683.959949:0:5821:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783141683.959953:0:5821:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1783141684.961712:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141685.990473:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141687.009715:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141687.633815:0:6063:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783141688.030147:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783141688.858623:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783141688.858632:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783141688.858636:0:38:0:(import.c:65:import_set_state_nolock()) 0000000010d67c4f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141688.858648:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000010d67c4f using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141688.858671:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001bb341a7 x1869759510482176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783141688.858788:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141688.858803:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004d7caf2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510482048:0@lo:400: 00000100:00100000:3.0:1783141688.858879:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141688.859036:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001bb341a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510482176:0@lo:38: 00000100:00100000:0.0:1783141688.859118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141688.859199:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510482176 00000100:00100000:3.0:1783141688.859206:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510482176 00000100:00100000:3.0:1783141688.859241:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141688.859247:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046f5125b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1869759510482176:12345-0@lo:38: 00010000:00080000:3.0:1783141688.859271:0:5788:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1783141688.859302:0:5788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x279ffa91da898464 00000004:00100000:3.0:1783141688.859392:0:5788:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783141688.859539:0:5788:0:(import.c:65:import_set_state_nolock()) 00000000eeca70a5 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783141688.859598:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046f5125b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1869759510482176:12345-0@lo:38: Request processed in 350us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141688.859605:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783141688.859645:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001bb341a7 x1869759510482176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783141688.859660:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783141688.859668:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783141688.859671:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783141688.859673:0:3304:0:(import.c:65:import_set_state_nolock()) 0000000010d67c4f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783141688.859678:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001bb341a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510482176:0@lo:38: 00000100:00100000:2.0:1783141688.860115:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510482048 00000100:00100000:2.0:1783141688.860121:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510482048 00000100:00100000:2.0:1783141688.860164:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783141688.860171:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002098f447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+11:3308:x1869759510482048:12345-0@lo:400: 00000100:00100000:2.0:1783141688.860225:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002098f447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+11:3308:x1869759510482048:12345-0@lo:400: Request processed in 54us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141688.860231:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141688.860334:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004d7caf2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510482048:0@lo:400: 00010000:00010000:3.0:1783141689.050827:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141690.074632:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783141690.394619:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783141690.394626:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff946489ce7800 from 3 10000000:01000000:2.0:1783141690.394631:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783141690.394671:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000009e1fa944/0x279ffa91da89846b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141690.394684:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 000000009e1fa944/0x279ffa91da89846b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141690.394694:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000009e1fa944/0x279ffa91da89846b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141690.394714:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008aa9926d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510482304:0@lo:101: 00000100:00100000:2.0:1783141690.394780:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141690.394831:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 0000000044c97942 going to sleep for 11 seconds 00000100:00100000:3.0:1783141690.394858:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510482304 00000100:00100000:3.0:1783141690.394866:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510482304 00000100:00100000:3.0:1783141690.394922:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783141690.394932:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b00ec2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:5784:x1869759510482304:12345-0@lo:101: 00010000:00010000:3.0:1783141690.394946:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141690.394960:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9727172/0x279ffa91da898472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89846b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141690.394982:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9727172/0x279ffa91da898472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89846b expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141690.394991:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9727172/0x279ffa91da898472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89846b expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141690.395000:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9727172, rc 0) 00000100:00100000:3.0:1783141690.395061:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b00ec2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510482304:12345-0@lo:101: Request processed in 131us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141690.395069:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783141690.395135:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008aa9926d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510482304:0@lo:101: 00010000:00010000:3.0:1783141690.395149:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000009e1fa944/0x279ffa91da89846b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141690.395157:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000009e1fa944/0x279ffa91da89846b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141690.395200:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510482432:0@lo:256: 00000100:00100000:3.0:1783141690.395241:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141690.395258:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set 0000000036e537ad going to sleep for 11 seconds 00000100:00100000:3.0:1783141690.395272:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510482432 00000100:00100000:3.0:1783141690.395275:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510482432 00000100:00100000:3.0:1783141690.395304:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141690.395309:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e19943c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510482432:12345-0@lo:256: 20000000:01000000:3.0:1783141690.395330:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783141690.395343:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783141690.395346:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783141690.395413:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e19943c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510482432:12345-0@lo:256: Request processed in 104us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141690.395420:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141690.395446:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510482432:0@lo:256: 10000000:01000000:3.0:1783141690.395800:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783141690.395807:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000009e1fa944/0x279ffa91da89846b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141690.395823:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 000000009e1fa944/0x279ffa91da89846b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141691.100583:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783141691.902697:0:6265:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2ff8c3e0 20000000:00000080:2.0:1783141691.902712:0:6265:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94649d18ec00 uarg=0000000000000000 20000000:01000000:2.0:1783141691.902742:0:6265:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783141691.902749:0:6265:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783141691.902754:0:6265:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783141691.903219:0:6265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1783141691.903230:0:6265:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1783141691.910213:0:6265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141691.911397:0:6265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783141691.911717:0:6265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1783141691.911774:0:6265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1783141691.911795:0:6265:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783141691.911811:0:6265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141691.911827:0:6265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898433 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141691.911834:0:6265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141691.911938:0:6265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898433 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141691.911951:0:6265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898433 expref: 11 pid: 5780 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141691.911966:0:6265:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6265:1869759510482560:0@lo:104: 00000100:00100000:3.0:1783141691.912101:0:6265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141691.912194:0:6265:0:(client.c:2701:ptlrpc_set_wait()) set 00000000de17564c going to sleep for 11 seconds 00000100:00100000:2.0:1783141691.912405:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510482560 00000100:00100000:2.0:1783141691.912412:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510482560 00000100:00100000:3.0:1783141691.912858:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141691.912867:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fbbf23d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:6265:x1869759510482560:12345-0@lo:104: 00010000:00010000:3.0:1783141691.912891:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141691.912970:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783141691.912975:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fbbf23d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:6265:x1869759510482560:12345-0@lo:104: Request processed in 110us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141691.912983:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783141691.913008:0:6265:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cb68d9c9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6265:1869759510482560:0@lo:104: 00010000:00010000:1.0:1783141691.913025:0:6265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141691.913029:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141691.913033:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141691.913041:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000980df65c already unused, calling callback (00000000ab8730ad) 10000000:00010000:2.0:1783141691.913044:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141691.913051:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141691.913058:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141691.913063:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141691.913096:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141691.913104:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141691.913122:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141691.913133:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 00000000980df65c/0x279ffa91da898433 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89843a expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141691.913146:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141691.913147:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141691.913149:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141691.913161:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002a5671d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510482688:0@lo:103: 00000100:00100000:2.0:1783141691.913192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141691.913563:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510482688 00000100:00100000:1.0:1783141691.913569:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510482688 00010000:00010000:1.0:1783141691.913590:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898433 expref: 12 pid: 5780 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141691.913620:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783141691.913634:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a632b1ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+12:3308:x1869759510482688:12345-0@lo:103: 00010000:00010000:1.0:1783141691.913644:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141691.913649:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898433 expref: 12 pid: 5780 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913658:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898433 expref: 12 pid: 5780 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913671:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000bbdc4a3/0x279ffa91da89843a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898433 expref: 12 pid: 5780 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913682:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913689:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913701:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913707:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913712:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913717:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913722:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000017441089 already unused, calling callback (000000001d5b734d) 00010000:00010000:1.0:1783141691.913725:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913737:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913758:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141691.913768:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141691.913808:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a632b1ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+11:3308:x1869759510482688:12345-0@lo:103: Request processed in 176us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141691.913815:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141691.913830:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002a5671d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510482688:0@lo:103: 00010000:00010000:0.0:1783141691.914314:0:6265:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141691.914325:0:6265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141691.914332:0:6265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000017441089/0x279ffa91da898479 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141692.122931:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141693.154015:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141693.979009:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006a49ef99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510482944:0@lo:400: 00000100:00100000:3.0:1783141693.979105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141693.979186:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141693.979192:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000089636d3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510482816:0@lo:400: 00000100:00100000:3.0:1783141693.979223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141693.979333:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510482944 00000100:00100000:2.0:1783141693.979344:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510482944 00000100:00100000:2.0:1783141693.979405:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141693.979414:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000877b3b98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510482944:12345-0@lo:400: 00000100:00100000:2.0:1783141693.979520:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000877b3b98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510482944:12345-0@lo:400: Request processed in 107us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141693.979528:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783141693.979641:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006a49ef99 x1869759510482944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141693.979657:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006a49ef99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510482944:0@lo:400: 00000100:00100000:0.0:1783141693.979790:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510482816 00000100:00100000:0.0:1783141693.979796:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510482816 00000100:00100000:0.0:1783141693.979835:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783141693.979841:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066f45ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+11:3306:x1869759510482816:12345-0@lo:400: 00000100:00100000:0.0:1783141693.979910:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066f45ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+11:3306:x1869759510482816:12345-0@lo:400: Request processed in 70us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141693.979919:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783141693.979996:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000089636d3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510482816:0@lo:400: 00010000:00010000:1.0:1783141694.177352:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141695.196515:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141696.219822:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783141697.135195:0:6582:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783141697.135198:0:6582:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783141697.135315:0:6582:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004f481f67 00000020:01000004:3.0:1783141697.135330:0:6582:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783141697.135342:0:6582:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783141697.135355:0:6582:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000c389e0d6) 00000020:00000080:3.0:1783141697.135372:0:6582:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783141697.149969:0:6582:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783141697.150301:0:6582:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783141697.176141:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783141697.181648:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783141697.181682:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783141697.181731:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783141697.181753:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783141697.182343:0:6582:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783141697.182354:0:6582:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783141697.182369:0:6582:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x279ffa91da898487 00000020:01000004:3.0:1783141697.182377:0:6582:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1783141697.182573:0:6582:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783141697.182577:0:6582:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783141697.182583:0:6582:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783141697.182588:0:6582:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783141697.182605:0:6582:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000ab465ac6) 00000020:00000080:3.0:1783141697.182616:0:6582:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1783141697.183785:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141697.184367:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783141697.184374:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783141697.189508:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783141697.189523:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783141697.194275:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783141697.194290:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783141697.196431:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783141697.196707:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783141697.196713:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783141697.198323:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783141697.198333:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783141697.229236:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141697.229727:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783141697.229735:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783141697.231679:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783141697.231692:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783141697.234604:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783141697.234619:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783141697.239129:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141697.239310:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783141697.239316:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783141697.240829:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783141697.241083:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1783141697.242690:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141697.320697:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141697.320863:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783141697.320973:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783141697.323361:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783141697.323375:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783141697.324351:0:6582:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783141697.324373:0:6582:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783141697.324378:0:6582:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783141697.372871:0:6582:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783141697.372909:0:6582:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.127@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1783141697.372913:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783141697.372915:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783141697.372919:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141697.372920:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141697.372921:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141697.372923:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141697.372924:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141697.372925:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141697.372926:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141697.372927:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141697.372929:0:6582:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783141697.372932:0:6582:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1783141697.372934:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783141697.372935:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783141697.372936:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141697.372937:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141697.372937:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141697.372938:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141697.372939:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141697.372940:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783141697.372941:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783141697.372941:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141697.372942:0:6582:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783141697.372977:0:6582:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783141697.372995:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002a5671d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510483072:0@lo:253: 00000100:00100000:2.0:1783141697.373064:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141697.373129:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 000000003d2d8e86 going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.373519:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510483072 00000100:00100000:3.0:1783141697.373527:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510483072 00000100:00100000:3.0:1783141697.373580:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783141697.373588:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a1b5f42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510483072:12345-0@lo:253: 20000000:01000000:3.0:1783141697.373619:0:5782:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783141697.373631:0:5782:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1783141697.373635:0:5782:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1783141697.373638:0:5782:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1783141697.374544:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141697.374769:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1783141697.374784:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1783141697.374824:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1783141697.374832:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1783141697.374862:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1783141697.374938:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1783141697.375304:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1783141697.375323:0:5782:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:3.0:1783141697.375325:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:3.0:1783141697.375357:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1783141697.375363:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783141697.375402:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1783141697.375408:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:3.0:1783141697.375435:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1783141697.375442:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783141697.375508:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1783141697.376439:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1783141697.378264:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1783141697.378292:0:5782:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:3.0:1783141697.378294:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:3.0:1783141697.378332:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1783141697.378340:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783141697.378371:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1783141697.378378:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:3.0:1783141697.378425:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1783141697.378434:0:5782:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783141697.378505:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1783141697.378545:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1783141697.378642:0:5782:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783141697.378645:0:5782:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783141697.378649:0:5782:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783141697.378660:0:5782:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783141697.378663:0:5782:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783141697.378694:0:5782:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783141697.378696:0:5782:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783141697.379538:0:6597:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1783141697.379684:0:6597:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1783141697.379738:0:6597:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1783141697.380273:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1783141697.380315:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1783141697.380375:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1783141697.380390:0:5782:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783141697.380392:0:5782:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783141697.381334:0:6598:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1783141697.381382:0:6598:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1783141697.381422:0:6598:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1783141697.382071:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1783141697.382174:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1783141697.382209:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1783141697.382221:0:5782:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783141697.382223:0:5782:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783141697.382743:0:6599:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1783141697.383362:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1783141697.383403:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1783141697.383755:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1783141697.383777:0:5782:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1783141697.383779:0:5782:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1783141697.383788:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783141697.383804:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.383823:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8983b5 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.383830:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8983d1 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.383848:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898441 expref: 11 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.383855:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.384055:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898441 expref: 11 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.384069:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898441 expref: 11 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141697.384083:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a1ee2c5c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5782:1869759510483200:0@lo:104: 00000100:00100000:1.0:1783141697.384213:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783141697.384303:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8983d1 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.384311:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8983d1 expref: 11 pid: 5779 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141697.384318:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b505965c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5782:1869759510483328:0@lo:104: 00000100:00100000:1.0:1783141697.384339:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783141697.384425:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8983b5 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.384433:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8983b5 expref: 11 pid: 5780 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141697.384440:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000097a9899d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5782:1869759510483456:0@lo:104: 00000100:00100000:1.0:1783141697.384509:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.384694:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510483200 00000100:00100000:0.0:1783141697.384702:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510483200 00000100:00100000:0.0:1783141697.384737:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510483328 00000100:00100000:0.0:1783141697.384740:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510483328 00000100:00100000:0.0:1783141697.384755:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141697.384761:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0a297b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+4:5782:x1869759510483200:12345-0@lo:104: 00010000:00010000:0.0:1783141697.384772:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.384820:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141697.384831:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0a297b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+4:5782:x1869759510483200:12345-0@lo:104: Request processed in 70us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141697.384837:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141697.384854:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141697.384859:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055f7e8be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:5782:x1869759510483328:12345-0@lo:104: 00010000:00010000:0.0:1783141697.384878:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.384920:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783141697.384924:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055f7e8be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:5782:x1869759510483328:12345-0@lo:104: Request processed in 66us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141697.384929:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783141697.384947:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141697.384951:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.384958:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000016a8b126 already unused, calling callback (00000000ab8730ad) 10000000:00010000:0.0:1783141697.384961:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.384968:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141697.384973:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141697.384978:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141697.385008:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385023:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141697.385040:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385046:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 0000000016a8b126/0x279ffa91da898441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898448 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385058:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141697.385060:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385065:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000020f52563 already unused, calling callback (00000000ab8730ad) 10000000:00010000:0.0:1783141697.385067:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385072:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141697.385077:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141697.385081:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141697.385092:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385097:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141697.385101:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385266:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 0000000020f52563/0x279ffa91da8983d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8983d8 expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385283:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141697.385284:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141697.385286:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141697.385297:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007ec9e35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510483584:0@lo:103: 00000100:00100000:0.0:1783141697.385325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.385360:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141697.385366:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000de808f5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510483712:0@lo:103: 00000100:00100000:0.0:1783141697.385386:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.385417:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510483584 00000100:00100000:0.0:1783141697.385421:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510483584 00010000:00010000:0.0:1783141697.385439:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898441 expref: 12 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.385477:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510483712 00000100:00100000:0.0:1783141697.385491:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510483712 00010000:00010000:0.0:1783141697.385502:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8983d1 expref: 13 pid: 5779 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.385515:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141697.385520:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af6b927f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+13:3307:x1869759510483584:12345-0@lo:103: 00010000:00010000:0.0:1783141697.385528:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141697.385532:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898441 expref: 13 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385539:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898441 expref: 13 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385553:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141697.385664:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783141697.385673:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1783141697.385778:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af6b927f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+13:3307:x1869759510483584:12345-0@lo:103: Request processed in 258us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141697.385785:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141697.385799:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141697.385803:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fe4bd4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+12:3307:x1869759510483712:12345-0@lo:103: 00010000:00010000:0.0:1783141697.385809:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141697.385813:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8983d1 expref: 12 pid: 5779 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385819:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8983d1 expref: 12 pid: 5779 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.385828:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141697.385849:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fe4bd4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+12:3307:x1869759510483712:12345-0@lo:103: Request processed in 46us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141697.385854:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783141697.386408:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 000000004149a6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1783141697.386431:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f2772b3a/0x279ffa91da898448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898441 expref: 11 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141697.386442:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a1ee2c5c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5782:1869759510483200:0@lo:104: 00010000:00010000:1.0:1783141697.386452:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065bc03ab/0x279ffa91da8983d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8983d1 expref: 10 pid: 5779 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141697.386494:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b505965c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5782:1869759510483328:0@lo:104: 00000100:00100000:2.0:1783141697.386724:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007ec9e35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510483584:0@lo:103: 00000100:00100000:2.0:1783141697.386746:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000de808f5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510483712:0@lo:103: 00000100:00100000:0.0:1783141697.386832:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510483456 00000100:00100000:0.0:1783141697.386839:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510483456 00000100:00100000:0.0:1783141697.386863:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141697.386881:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c229f48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:5782:x1869759510483456:12345-0@lo:104: 00010000:00010000:0.0:1783141697.386900:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.386959:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141697.386964:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c229f48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:5782:x1869759510483456:12345-0@lo:104: Request processed in 85us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141697.386970:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1783141697.387071:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141697.387075:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.387082:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000180d3d86 already unused, calling callback (00000000ab8730ad) 10000000:00010000:2.0:1783141697.387092:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.387099:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141697.387118:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141697.387123:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141697.387156:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.387162:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141697.387176:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.387181:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 00000000180d3d86/0x279ffa91da8983b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8983bc expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.387194:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141697.387196:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141697.387197:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141697.387314:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000be7973f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510483840:0@lo:103: 00000100:00100000:1.0:1783141697.387345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141697.387389:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000097a9899d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5782:1869759510483456:0@lo:104: 00010000:00010000:1.0:1783141697.387408:0:5782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.387450:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510483840 00000100:00100000:0.0:1783141697.387454:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510483840 00010000:00010000:0.0:1783141697.387516:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8983b5 expref: 10 pid: 5780 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.387537:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141697.387542:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d96553bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+10:3305:x1869759510483840:12345-0@lo:103: 00010000:00010000:0.0:1783141697.387550:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141697.387554:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8983b5 expref: 10 pid: 5780 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387671:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8983b5 expref: 10 pid: 5780 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387683:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007090a5ea/0x279ffa91da8983bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8983b5 expref: 10 pid: 5780 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387694:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387701:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387715:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387721:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387726:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387731:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387748:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ecbfb9f9 already unused, calling callback (000000001d5b734d) 00010000:00010000:0.0:1783141697.387751:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387757:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387777:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.387788:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141697.387821:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d96553bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+9:3305:x1869759510483840:12345-0@lo:103: Request processed in 279us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141697.387828:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783141697.387870:0:5782:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.387876:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.387882:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ecbfb9f9/0x279ffa91da898495 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783141697.387904:0:5782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783141697.388073:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000be7973f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510483840:0@lo:103: 00010000:00010000:3.0:1783141697.389200:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141697.432561:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a1b5f42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+8:6582:x1869759510483072:12345-0@lo:253: Request processed in 58967us (59491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141697.432576:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783141697.432654:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002a5671d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510483072:0@lo:253: 10000000:01000000:0.0:1783141697.432669:0:6582:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783141697.432672:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783141697.432674:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783141697.432675:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141697.432676:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1783141697.432677:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141697.432679:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141697.432681:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141697.432682:0:6582:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783141697.432683:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141697.432684:0:6582:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783141697.432704:0:6582:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004f481f67 from lustre-OST0000 10000000:01000000:0.0:1783141697.432727:0:6582:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783141697.432730:0:6582:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783141697.432737:0:6582:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff946482f299c0 local copy 10000000:01000000:0.0:1783141697.432740:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783141697.432784:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.432792:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.432798:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.432811:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000060fcf629 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510483968:0@lo:101: 00000100:00100000:0.0:1783141697.432845:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.432904:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000db2cb5e7 going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.432962:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510483968 00000100:00100000:3.0:1783141697.432968:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510483968 00000100:00100000:3.0:1783141697.433007:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783141697.433014:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ed1c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+8:6582:x1869759510483968:12345-0@lo:101: 00010000:00010000:3.0:1783141697.433041:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141697.433054:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a358fa1/0x279ffa91da8984a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89849c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.433075:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a358fa1/0x279ffa91da8984a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89849c expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.433084:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a358fa1/0x279ffa91da8984a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89849c expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.433093:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a358fa1, rc 0) 00000100:00100000:3.0:1783141697.433137:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ed1c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+9:6582:x1869759510483968:12345-0@lo:101: Request processed in 123us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.433149:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783141697.433274:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000060fcf629 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510483968:0@lo:101: 00010000:00010000:2.0:1783141697.433286:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.433305:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141697.433395:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000be7973f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484096:0@lo:501: 00000100:00100000:2.0:1783141697.433421:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141697.433520:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 000000003c1e8d2d going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.433634:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510484096 00000100:00100000:3.0:1783141697.433639:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510484096 00000100:00100000:3.0:1783141697.433660:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783141697.433665:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042bb8d9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+9:6582:x1869759510484096:12345-0@lo:501: 00000100:00100000:3.0:1783141697.434043:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042bb8d9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+9:6582:x1869759510484096:12345-0@lo:501: Request processed in 377us (621us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783141697.434050:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783141697.434066:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000be7973f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484096:0@lo:501: 10000000:01000000:2.0:1783141697.434080:0:6582:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783141697.434108:0:6582:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783141697.434113:0:6582:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.434120:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.434127:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.434144:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783141697.434151:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141697.434156:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141697.434160:0:6582:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94649d28d000 00010000:00010000:0.0:1783141697.434163:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007090a5ea already unused, calling callback (00000000ab8730ad) 10000000:01000000:2.0:1783141697.434164:0:6582:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:00010000:0.0:1783141697.434166:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141697.434168:0:6582:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff946482f299c0 10000000:01000000:2.0:1783141697.434170:0:6582:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783141697.434173:0:6582:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff946482f299c0 from 1 00010000:00010000:0.0:1783141697.434174:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141697.434175:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:00010000:0.0:1783141697.434190:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.434192:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000001edce378/0x279ffa91da8984aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141697.434196:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141697.434208:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 000000001edce378/0x279ffa91da8984aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.434211:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.434215:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000001edce378/0x279ffa91da8984aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.434216:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783141697.434226:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000be7973f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484224:0@lo:101: 00010000:00010000:0.0:1783141697.434257:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141697.434261:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783141697.434264:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: 000000007090a5ea/0x279ffa91da89849c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x279ffa91da8984a3 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141697.434273:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000655fb772 going to sleep for 11 seconds 00010000:00010000:0.0:1783141697.434279:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141697.434280:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141697.434282:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141697.434397:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b0d27d52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510484352:0@lo:103: 00000100:00100000:3.0:1783141697.434597:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510484224 00000100:00100000:3.0:1783141697.434603:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510484224 00000100:00100000:3.0:1783141697.434638:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783141697.434645:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4fe2b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+9:6582:x1869759510484224:12345-0@lo:101: 00010000:00010000:3.0:1783141697.434654:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141697.434665:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006ed8078a/0x279ffa91da8984b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8984aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.434681:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ed8078a/0x279ffa91da8984b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8984aa expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.434690:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006ed8078a/0x279ffa91da8984b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8984aa expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.434698:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006ed8078a, rc 0) 00000100:00100000:3.0:1783141697.434741:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4fe2b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484224:12345-0@lo:101: Request processed in 97us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.434751:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783141697.434999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141697.435048:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510484352 00000100:00100000:1.0:1783141697.435052:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510484352 00000100:00100000:1.0:1783141697.435080:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141697.435086:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097a9899d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+10:3306:x1869759510484352:12345-0@lo:103: 00010000:00010000:1.0:1783141697.435095:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141697.435105:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007a358fa1/0x279ffa91da8984a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da89849c expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141697.435117:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141697.435152:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097a9899d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+9:3306:x1869759510484352:12345-0@lo:103: Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141697.435159:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141697.435186:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b0d27d52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510484352:0@lo:103: 00000100:00100000:0.0:1783141697.435223:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000be7973f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484224:0@lo:101: 00010000:00010000:0.0:1783141697.435235:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000001edce378/0x279ffa91da8984aa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984b1 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.435244:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000001edce378/0x279ffa91da8984aa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8984b1 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141697.435258:0:6582:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783141697.435270:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000001edce378/0x279ffa91da8984aa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984b1 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.435276:0:6582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 000000001edce378/0x279ffa91da8984aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984b1 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141697.435282:0:6582:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783141697.435286:0:6582:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783141697.435291:0:6582:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783141697.435293:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783141697.435308:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da8984b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.435325:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da8984b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.435332:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da8984b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.435345:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484480:0@lo:101: 00000100:00100000:0.0:1783141697.435372:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.435394:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa288990 going to sleep for 11 seconds 00000100:00100000:2.0:1783141697.435520:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510484480 00000100:00100000:2.0:1783141697.435524:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510484480 00000100:00100000:2.0:1783141697.435556:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783141697.435562:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8358dab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+9:6582:x1869759510484480:12345-0@lo:101: 00010000:00010000:2.0:1783141697.435570:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141697.435579:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef0ac1d7/0x279ffa91da8984bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8984b8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.435592:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef0ac1d7/0x279ffa91da8984bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8984b8 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.435599:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef0ac1d7/0x279ffa91da8984bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8984b8 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.435605:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef0ac1d7, rc 0) 00000100:00100000:2.0:1783141697.435637:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8358dab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484480:12345-0@lo:101: Request processed in 75us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141697.435651:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783141697.436002:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484480:0@lo:101: 00010000:00010000:0.0:1783141697.436014:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da8984b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.436021:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da8984b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.436108:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484608:0@lo:501: 00000100:00100000:0.0:1783141697.436147:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141697.436190:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510484608 00000100:00100000:2.0:1783141697.436194:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510484608 00000100:00100000:2.0:1783141697.436227:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783141697.436233:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005afa6d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484608:12345-0@lo:501: 00000100:00100000:0.0:1783141697.436277:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa288990 going to sleep for 11 seconds 00000100:00100000:2.0:1783141697.436491:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005afa6d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484608:12345-0@lo:501: Request processed in 257us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141697.436498:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783141697.436625:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484608:0@lo:501: 00000100:00100000:0.0:1783141697.436654:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484736:0@lo:503: 00000100:00100000:0.0:1783141697.436690:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.436719:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa288990 going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.436807:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510484736 00000100:00100000:3.0:1783141697.436812:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510484736 00000100:00100000:3.0:1783141697.436890:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783141697.436897:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0a30967 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484736:12345-0@lo:503: 00000100:00100000:3.0:1783141697.437042:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0a30967 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484736:12345-0@lo:503: Request processed in 146us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.437048:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783141697.437108:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484736:0@lo:503: 00000040:00080000:0.0:1783141697.437399:0:6582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783141697.437490:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484864:0@lo:502: 00000100:00100000:0.0:1783141697.437524:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141697.439042:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510484864 00000100:00100000:2.0:1783141697.439052:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510484864 00000100:00100000:2.0:1783141697.439093:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783141697.439100:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4be36a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484864:12345-0@lo:502: 00000100:00100000:2.0:1783141697.439317:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4be36a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484864:12345-0@lo:502: Request processed in 217us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141697.439324:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783141697.439412:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa288990 going to sleep for 11 seconds 00000100:00100000:0.0:1783141697.439441:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484864:0@lo:502: 00000040:00080000:0.0:1783141697.439711:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783141697.439774:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783141697.439805:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783141697.440284:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783141697.440339:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783141697.440375:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783141697.440412:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484992:0@lo:502: 00000100:00100000:0.0:1783141697.440603:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.440645:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fa288990 going to sleep for 11 seconds 00000100:00100000:1.0:1783141697.440790:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510484992 00000100:00100000:1.0:1783141697.440796:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510484992 00000100:00100000:1.0:1783141697.441006:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783141697.441016:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bedf9d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484992:12345-0@lo:502: 00000100:00100000:1.0:1783141697.441210:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bedf9d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510484992:12345-0@lo:502: Request processed in 195us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141697.441218:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783141697.441299:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510484992:0@lo:502: 00000040:00080000:0.0:1783141697.441401:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783141697.441411:0:6582:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1783141697.442672:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783141697.442684:0:6601:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1783141697.442690:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141697.442692:0:6601:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783141697.442698:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141697.442724:0:6601:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000049b8fdd5) 00000020:00000080:0.0:1783141697.442745:0:6601:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783141697.442751:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783141697.442846:0:6601:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004f481f67 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783141697.442853:0:6601:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783141697.442868:0:6601:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x279ffa91da8984cd 00010000:00010000:1.0:1783141697.452303:0:6601:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1783141697.452693:0:6601:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1783141697.459608:0:6601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783141697.460813:0:6601:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1783141697.476300:0:6601:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1783141697.478325:0:6601:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1783141697.483596:0:6601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783141697.483611:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141697.483619:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141697.483621:0:6601:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783141697.483626:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141697.483629:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141697.483630:0:6601:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783141697.483633:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783141697.483635:0:6601:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783141697.483690:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141697.483693:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141697.483694:0:6601:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783141697.483697:0:6601:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783141697.483992:0:6582:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1783141697.484016:0:6582:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783141697.484048:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da8984b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.484059:0:6582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: 000000006151b17e/0x279ffa91da8984b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141697.484067:0:6582:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff94649d28d000 from 1 10000000:01000000:2.0:1783141697.484070:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783141697.484107:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: 00000000810aad06/0x279ffa91da8984d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.484126:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: 00000000810aad06/0x279ffa91da8984d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.484136:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: 00000000810aad06/0x279ffa91da8984d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141697.484158:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000793f96fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485120:0@lo:101: 00000100:00100000:2.0:1783141697.484233:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141697.484279:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 000000001520046b going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.484621:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510485120 00000100:00100000:3.0:1783141697.484629:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510485120 00000100:00100000:3.0:1783141697.484670:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783141697.484677:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009ad7995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+10:6582:x1869759510485120:12345-0@lo:101: 00010000:00010000:3.0:1783141697.484692:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141697.484705:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a6eca70/0x279ffa91da8984db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8984d4 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.484728:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a6eca70/0x279ffa91da8984db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8984d4 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.484736:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a6eca70/0x279ffa91da8984db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8984d4 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.484753:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a6eca70, rc 0) 00000100:00100000:3.0:1783141697.484806:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009ad7995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485120:12345-0@lo:101: Request processed in 130us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.484813:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783141697.484910:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000793f96fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485120:0@lo:101: 00010000:00010000:0.0:1783141697.484926:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: 00000000810aad06/0x279ffa91da8984d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.484940:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: 00000000810aad06/0x279ffa91da8984d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.485380:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485248:0@lo:501: 00000100:00100000:0.0:1783141697.487509:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.487549:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000db2cb5e7 going to sleep for 11 seconds 00000100:00100000:2.0:1783141697.490115:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510485248 00000100:00100000:2.0:1783141697.490129:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510485248 00000100:00100000:2.0:1783141697.490762:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783141697.490772:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009467e867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485248:12345-0@lo:501: 00000100:00100000:2.0:1783141697.491080:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009467e867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485248:12345-0@lo:501: Request processed in 309us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141697.491089:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783141697.491684:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485248:0@lo:501: 00000100:00100000:0.0:1783141697.491729:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485376:0@lo:503: 00000100:00100000:0.0:1783141697.491773:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.493137:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000db2cb5e7 going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.493224:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510485376 00000100:00100000:3.0:1783141697.493232:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510485376 00000100:00100000:3.0:1783141697.493268:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783141697.493275:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003da9f5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485376:12345-0@lo:503: 00000100:00100000:3.0:1783141697.493697:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003da9f5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485376:12345-0@lo:503: Request processed in 421us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.493705:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783141697.493807:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485376:0@lo:503: 00000040:00080000:0.0:1783141697.494410:0:6582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783141697.494618:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485504:0@lo:502: 00000100:00100000:0.0:1783141697.494670:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.494695:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ab517eeb going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.494765:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510485504 00000100:00100000:3.0:1783141697.494771:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510485504 00000100:00100000:3.0:1783141697.494797:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783141697.494804:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f036fff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485504:12345-0@lo:502: 00000100:00100000:3.0:1783141697.495135:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f036fff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485504:12345-0@lo:502: Request processed in 331us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.495143:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141697.495219:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485504:0@lo:502: 00000040:00080000:0.0:1783141697.495651:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783141697.495701:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783141697.495726:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485632:0@lo:502: 00000100:00100000:0.0:1783141697.495766:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.495823:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set 00000000594ce70c going to sleep for 11 seconds 00000100:00100000:2.0:1783141697.495878:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510485632 00000100:00100000:2.0:1783141697.495884:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510485632 00000100:00100000:3.0:1783141697.496094:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783141697.496107:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007421d4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485632:12345-0@lo:502: 00000100:00100000:3.0:1783141697.496259:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007421d4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485632:12345-0@lo:502: Request processed in 155us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.496267:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783141697.496340:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008963302c pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485632:0@lo:502: 00000040:00080000:0.0:1783141697.496438:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783141697.496447:0:6582:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1783141697.497155:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141697.497166:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141697.497168:0:6605:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783141697.497174:0:6605:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94649d28d000 00000020:00000080:1.0:1783141697.497183:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783141697.497222:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141697.497226:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141697.497228:0:6605:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783141697.497231:0:6605:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783141697.497342:0:6582:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783141697.497361:0:6582:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783141697.497387:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.497399:0:6582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141697.497435:0:6582:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783141697.497438:0:6582:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94649d28d000 10000000:01000000:0.0:1783141697.497442:0:6582:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94649d28d000 10000000:01000000:0.0:1783141697.497446:0:6582:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783141697.497450:0:6582:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff94649d28d000 from 1 10000000:01000000:0.0:1783141697.497453:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783141697.497515:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.497524:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.497533:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.497551:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485760:0@lo:101: 00000100:00100000:0.0:1783141697.497597:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.497630:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489e42780 going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.497733:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510485760 00000100:00100000:3.0:1783141697.497738:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510485760 00000100:00100000:3.0:1783141697.497783:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783141697.497791:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510485760:12345-0@lo:101: 00010000:00010000:3.0:1783141697.497802:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141697.497813:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8984e2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.497834:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8984e2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.497845:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8984e2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.497854:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174600, rc 0) 00000100:00100000:3.0:1783141697.497886:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510485760:12345-0@lo:101: Request processed in 96us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.497962:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783141697.498105:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485760:0@lo:101: 00010000:00010000:0.0:1783141697.498118:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.498137:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.498209:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485888:0@lo:501: 00000100:00100000:0.0:1783141697.498234:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.498256:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489e42780 going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.498339:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510485888 00000100:00100000:3.0:1783141697.498344:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510485888 00000100:00100000:3.0:1783141697.498372:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783141697.498379:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510485888:12345-0@lo:501: 00000100:00100000:3.0:1783141697.498638:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510485888:12345-0@lo:501: Request processed in 259us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.498645:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783141697.498763:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510485888:0@lo:501: 00000100:00100000:1.0:1783141697.498792:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510486016:0@lo:503: 00000100:00100000:1.0:1783141697.498829:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141697.498848:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464864a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141697.498965:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510486016 00000100:00100000:0.0:1783141697.498969:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510486016 00000100:00100000:0.0:1783141697.498989:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783141697.498996:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510486016:12345-0@lo:503: 00000100:00100000:0.0:1783141697.499273:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510486016:12345-0@lo:503: Request processed in 275us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141697.499280:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783141697.499695:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510486016:0@lo:503: 00000040:00080000:0.0:1783141697.500171:0:6582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783141697.500246:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510486144:0@lo:502: 00000100:00100000:0.0:1783141697.500290:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.500360:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489e42600 going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.500455:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510486144 00000100:00100000:3.0:1783141697.500881:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510486144 00000100:00100000:3.0:1783141697.501037:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783141697.501046:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510486144:12345-0@lo:502: 00000100:00100000:3.0:1783141697.501291:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510486144:12345-0@lo:502: Request processed in 246us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.501304:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783141697.501743:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510486144:0@lo:502: 00000040:00080000:0.0:1783141697.502249:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783141697.502304:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783141697.502354:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783141697.502566:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783141697.502607:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783141697.502672:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783141697.502708:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783141697.502738:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783141697.502781:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783141697.502815:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783141697.502862:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783141697.502993:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783141697.503111:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783141697.503151:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783141697.503201:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783141697.503238:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783141697.503273:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783141697.503346:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783141697.503798:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783141697.503839:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783141697.503886:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783141697.503998:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783141697.504114:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783141697.504168:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783141697.504204:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783141697.504232:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783141697.504277:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783141697.504312:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1783141697.504362:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510486272:0@lo:502: 00000100:00100000:0.0:1783141697.504685:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.504733:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489e423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.504798:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510486272 00000100:00100000:3.0:1783141697.504806:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510486272 00000100:00100000:3.0:1783141697.504857:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783141697.504866:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510486272:12345-0@lo:502: 00000100:00100000:3.0:1783141697.505212:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510486272:12345-0@lo:502: Request processed in 346us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.505220:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783141697.505311:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510486272:0@lo:502: 00000040:00080000:0.0:1783141697.505403:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783141697.505413:0:6582:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1783141697.506290:0:6606:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783141697.506303:0:6606:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9464bfed3380) 00000020:00000080:0.0:1783141697.506322:0:6606:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1783141697.506759:0:6606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94649d28d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783141697.506764:0:6606:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94649d28d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783141697.506766:0:6606:0:(obd_mount.c:701:lustre_put_lsi()) put ffff94649d28d000 3 00010000:00080000:0.0:1783141697.506795:0:6606:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946381372000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.127@tcp at head 00010000:00010000:0.0:1783141697.510003:0:6606:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1783141697.511235:0:6606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1783141697.511274:0:6606:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783141697.511287:0:6606:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x279ffa91da8984f7 00000100:00080000:0.0:1783141697.511297:0:6606:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783141697.511304:0:6606:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff946381372000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1783141697.511337:0:6606:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496f82680 x1869759510486400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783141697.511364:0:6606:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783141697.511442:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1869759510486400:0@lo:38: 00000100:00100000:3.0:1783141697.511542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141697.511636:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510486528:0@lo:400: 00000100:00100000:3.0:1783141697.511662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141697.511695:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510486400 00000100:00100000:3.0:1783141697.511701:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510486400 00000100:00100000:3.0:1783141697.511723:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510486528 00000100:00100000:3.0:1783141697.511726:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510486528 00000100:00100000:3.0:1783141697.511749:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141697.511757:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510486528:12345-0@lo:400: 00000100:00100000:3.0:1783141697.511808:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510486528:12345-0@lo:400: Request processed in 51us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.511815:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141697.511830:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141697.511834:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1869759510486400:12345-0@lo:38: 00010000:00080000:3.0:1783141697.511852:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:3.0:1783141697.511880:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x279ffa91da8984fe 00000004:00100000:3.0:1783141697.511961:0:5787:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783141697.511998:0:5787:0:(import.c:65:import_set_state_nolock()) ffff946496822000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783141697.512107:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1869759510486400:12345-0@lo:38: Request processed in 271us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141697.512115:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783141697.512152:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946482f4ed80 x1869759510486528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141697.512165:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510486528:0@lo:400: 00010000:00080000:3.0:1783141697.512191:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946496f82680 x1869759510486400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141697.512200:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783141697.512205:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1783141697.512212:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783141697.512216:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783141697.512218:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946381372000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783141697.512224:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1869759510486400:0@lo:38: 00000040:00080000:3.0:1783141697.512455:0:6606:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1783141697.513523:0:6582:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1783141697.513551:0:6582:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141697.513574:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.513585:0:6582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783141697.513625:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783141697.513628:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783141697.513629:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141697.513630:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141697.513632:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141697.513633:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141697.513634:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141697.513636:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783141697.513637:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783141697.513638:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141697.513640:0:6582:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783141697.513643:0:6582:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1783141697.513645:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783141697.513647:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783141697.513648:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141697.513649:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141697.513650:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141697.513656:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141697.513657:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141697.513658:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783141697.513659:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783141697.513660:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141697.513661:0:6582:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783141697.513681:0:6582:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783141697.513693:0:6582:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510486656:0@lo:253: 00000100:00100000:0.0:1783141697.513744:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.513774:0:6582:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489e429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141697.523273:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510486656 00000100:00100000:3.0:1783141697.523287:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510486656 00000100:00100000:3.0:1783141697.523339:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783141697.523349:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:6582:x1869759510486656:12345-0@lo:253: 20000000:01000000:3.0:1783141697.523378:0:5780:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783141697.523402:0:5780:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783141697.551901:0:5780:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783141697.551919:0:5780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783141697.552048:0:5802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783141697.552053:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783141697.552072:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.552090:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2174400/0x279ffa91da898472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89846b expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.552099:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.552134:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2174400/0x279ffa91da898472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da89846b expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.552148:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464c2174400/0x279ffa91da898472 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da89846b expref: 12 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141697.552163:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1869759510486784:0@lo:104: 00000100:00100000:0.0:1783141697.552222:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141697.552276:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489e42480 going to sleep for 11 seconds 00000100:00100000:2.0:1783141697.552343:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510486784 00000100:00100000:2.0:1783141697.552351:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510486784 00000100:00100000:2.0:1783141697.552402:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783141697.552411:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:5802:x1869759510486784:12345-0@lo:104: 00010000:00010000:2.0:1783141697.552424:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464c2042600/0x279ffa91da89846b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.552508:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783141697.552513:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:5802:x1869759510486784:12345-0@lo:104: Request processed in 104us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141697.552532:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783141697.552659:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1869759510486784:0@lo:104: 00010000:00010000:0.0:1783141697.552679:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.554441:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141697.554452:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464c2042600/0x279ffa91da89846b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.554704:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2042600 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:3.0:1783141697.554721:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464c2042600/0x279ffa91da89846b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141697.554730:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2042600/0x279ffa91da89846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141697.554738:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2042600/0x279ffa91da89846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141697.554745:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141697.554834:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464c2042600/0x279ffa91da89846b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.554841:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141697.554857:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464c2042600/0x279ffa91da89846b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.554863:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2042600/0x279ffa91da89846b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898472 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.554881:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141697.554883:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141697.554884:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141697.554989:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510486912:0@lo:103: 00000100:00100000:1.0:1783141697.555048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141697.555141:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510486912 00000100:00100000:2.0:1783141697.555148:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510486912 00010000:00010000:2.0:1783141697.555173:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2174400/0x279ffa91da898472 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89846b expref: 13 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141697.555207:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783141697.555216:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+13:3308:x1869759510486912:12345-0@lo:103: 00010000:00010000:2.0:1783141697.555228:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141697.555234:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2174400/0x279ffa91da898472 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89846b expref: 13 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555244:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2174400/0x279ffa91da898472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da89846b expref: 13 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555257:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2174400/0x279ffa91da898472 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da89846b expref: 13 pid: 5782 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555282:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555290:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783141697.555303:0:5773:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004022317s 00010000:00010000:2.0:1783141697.555307:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555314:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555320:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555326:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555331:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141697.555335:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555341:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555356:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141697.555365:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141697.555416:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+12:3308:x1869759510486912:12345-0@lo:103: Request processed in 201us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141697.555423:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783141697.555625:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510486912:0@lo:103: 00010000:00010000:0.0:1783141697.556598:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.556611:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141697.556616:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480030800/0x279ffa91da898505 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141697.562436:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:6582:x1869759510486656:12345-0@lo:253: Request processed in 39080us (48683us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141697.562452:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783141697.562717:0:6582:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:6582:1869759510486656:0@lo:253: 10000000:01000000:0.0:1783141697.562732:0:6582:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783141697.562735:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783141697.562737:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783141697.562738:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141697.562739:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141697.562740:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141697.562741:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141697.562743:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141697.562744:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783141697.562746:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783141697.562747:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141697.562749:0:6582:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783141697.562762:0:6582:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783141697.567726:0:6582:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783141697.567993:0:6582:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783141697.568198:0:6582:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783141697.568492:0:6582:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783141697.568687:0:6582:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783141697.569294:0:6582:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783141697.570378:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783141697.797727:0:6582:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783141697.797746:0:6582:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783141697.797840:0:6582:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783141697.797893:0:6582:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783141697.797907:0:6582:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783141697.797933:0:6582:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:3.0:1783141698.140744:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783141698.140751:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff946489ce7800 from 21 10000000:01000000:3.0:1783141698.140755:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783141698.140796:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.140809:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.140820:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141698.140841:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487040:0@lo:101: 00000100:00100000:3.0:1783141698.141057:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141698.141141:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981b480 going to sleep for 11 seconds 00000100:00100000:1.0:1783141698.141753:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510487040 00000100:00100000:1.0:1783141698.141762:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510487040 00000100:00100000:1.0:1783141698.141850:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783141698.141861:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:5784:x1869759510487040:12345-0@lo:101: 00010000:00010000:1.0:1783141698.141876:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141698.141961:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89850c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141698.142001:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89850c expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141698.142013:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89850c expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141698.142021:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a7200, rc 0) 00000100:00100000:1.0:1783141698.142076:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510487040:12345-0@lo:101: Request processed in 217us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141698.142083:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783141698.142179:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487040:0@lo:101: 00010000:00010000:1.0:1783141698.142200:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141698.142209:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141698.142262:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487168:0@lo:501: 00000100:00100000:1.0:1783141698.142288:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141698.142349:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bb125600 going to sleep for 11 seconds 00000100:00100000:3.0:1783141698.142644:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510487168 00000100:00100000:3.0:1783141698.142649:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510487168 00000100:00100000:3.0:1783141698.142716:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783141698.142724:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510487168:12345-0@lo:501: 00000100:00100000:3.0:1783141698.143047:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510487168:12345-0@lo:501: Request processed in 323us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141698.143060:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783141698.143184:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487168:0@lo:501: 00000100:00100000:1.0:1783141698.143226:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487296:0@lo:503: 00000100:00100000:1.0:1783141698.143264:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141698.143287:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bb125600 going to sleep for 11 seconds 00000100:00100000:1.0:1783141698.143300:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510487296 00000100:00100000:1.0:1783141698.143304:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510487296 00000100:00100000:1.0:1783141698.143332:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783141698.143338:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510487296:12345-0@lo:503: 00000100:00100000:1.0:1783141698.143652:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510487296:12345-0@lo:503: Request processed in 313us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141698.143659:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783141698.143695:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487296:0@lo:503: 00000100:00100000:1.0:1783141698.144278:0:6629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6629:1869759510487424:0@lo:502: 00000100:00100000:1.0:1783141698.144317:0:6629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141698.144523:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510487424 00000100:00100000:3.0:1783141698.144529:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510487424 00000100:00100000:3.0:1783141698.144563:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783141698.144571:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:6629:x1869759510487424:12345-0@lo:502: 00000100:00100000:3.0:1783141698.144780:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:6629:x1869759510487424:12345-0@lo:502: Request processed in 209us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141698.144786:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783141698.144867:0:6629:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bb125a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141698.144882:0:6629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6629:1869759510487424:0@lo:502: 00000100:00100000:1.0:1783141698.144998:0:6629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6629:1869759510487552:0@lo:502: 00000100:00100000:1.0:1783141698.145029:0:6629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141698.145054:0:6629:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bb125a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141698.145096:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510487552 00000100:00100000:3.0:1783141698.145100:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510487552 00000100:00100000:3.0:1783141698.145162:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783141698.145169:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:6629:x1869759510487552:12345-0@lo:502: 00000100:00100000:3.0:1783141698.145311:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:6629:x1869759510487552:12345-0@lo:502: Request processed in 141us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141698.145318:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783141698.145689:0:6629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6629:1869759510487552:0@lo:502: 00000040:00080000:1.0:1783141698.145711:0:6629:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1783141698.148521:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1783141698.148554:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141698.148566:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.148579:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141698.148589:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783141698.148592:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff946489ce7800 from 4 10000000:01000000:0.0:1783141698.148594:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783141698.148640:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.148649:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.148660:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141698.148680:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487680:0@lo:101: 00000100:00100000:0.0:1783141698.148739:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141698.148786:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486611900 going to sleep for 11 seconds 00000100:00100000:2.0:1783141698.150034:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510487680 00000100:00100000:2.0:1783141698.150045:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510487680 00000100:00100000:2.0:1783141698.150101:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783141698.150110:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510487680:12345-0@lo:101: 00010000:00010000:2.0:1783141698.150125:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141698.150140:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89851a expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141698.150165:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89851a expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141698.150176:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89851a expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141698.150184:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2042600, rc 0) 00000100:00100000:2.0:1783141698.150244:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510487680:12345-0@lo:101: Request processed in 135us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141698.150250:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783141698.150428:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487680:0@lo:101: 00010000:00010000:0.0:1783141698.150445:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.150517:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141698.150569:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487808:0@lo:256: 00000100:00100000:0.0:1783141698.150599:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141698.150631:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486611900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141698.150973:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510487808 00000100:00100000:3.0:1783141698.150979:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510487808 00000100:00100000:3.0:1783141698.151015:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783141698.151023:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510487808:12345-0@lo:256: 20000000:01000000:3.0:1783141698.151037:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783141698.151053:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783141698.151056:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1783141698.151138:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510487808:12345-0@lo:256: Request processed in 115us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141698.151144:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783141698.152398:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487808:0@lo:256: 10000000:01000000:0.0:1783141698.152456:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783141698.152494:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.152505:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141698.152514:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783141698.152516:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1783141698.152519:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783141698.152544:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.152553:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.152562:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141698.152575:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487936:0@lo:101: 00000100:00100000:0.0:1783141698.152623:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141698.152662:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486611900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141698.152974:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510487936 00000100:00100000:3.0:1783141698.152981:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510487936 00000100:00100000:3.0:1783141698.153038:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783141698.153047:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510487936:12345-0@lo:101: 00010000:00010000:3.0:1783141698.153059:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141698.153071:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898528 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.153091:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898528 expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.153102:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898528 expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.153111:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175400, rc 0) 00000100:00100000:3.0:1783141698.153145:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510487936:12345-0@lo:101: Request processed in 98us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141698.153150:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783141698.153233:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510487936:0@lo:101: 00010000:00010000:0.0:1783141698.153245:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.153253:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141698.153300:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510488064:0@lo:501: 00000100:00100000:0.0:1783141698.153325:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141698.153348:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486611900 going to sleep for 11 seconds 00000100:00100000:0.0:1783141698.153362:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510488064 00000100:00100000:0.0:1783141698.153365:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510488064 00000100:00100000:0.0:1783141698.153397:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783141698.153403:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510488064:12345-0@lo:501: 00000100:00100000:0.0:1783141698.153679:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510488064:12345-0@lo:501: Request processed in 275us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141698.153686:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783141698.153716:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510488064:0@lo:501: 00000100:00100000:0.0:1783141698.153753:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510488192:0@lo:503: 00000100:00100000:0.0:1783141698.153790:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141698.153805:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486611900 going to sleep for 11 seconds 00000100:00100000:0.0:1783141698.153816:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510488192 00000100:00100000:0.0:1783141698.153819:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510488192 00000100:00100000:0.0:1783141698.153837:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783141698.153842:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510488192:12345-0@lo:503: 00000100:00100000:0.0:1783141698.154135:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510488192:12345-0@lo:503: Request processed in 291us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141698.154142:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783141698.154177:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510488192:0@lo:503: 00000100:00100000:0.0:1783141698.154345:0:6630:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6630:1869759510488320:0@lo:502: 00000100:00100000:0.0:1783141698.154377:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141698.154394:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510488320 00000100:00100000:0.0:1783141698.154397:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510488320 00000100:00100000:0.0:1783141698.154412:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783141698.154417:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:6630:x1869759510488320:12345-0@lo:502: 00000100:00100000:0.0:1783141698.154623:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:6630:x1869759510488320:12345-0@lo:502: Request processed in 203us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141698.154630:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783141698.154660:0:6630:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486611e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141698.154671:0:6630:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6630:1869759510488320:0@lo:502: 00000020:01000000:0.0:1783141698.154692:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783141698.154699:0:6630:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783141698.154705:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141698.154707:0:6630:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783141698.154711:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783141698.154715:0:6630:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:0.0:1783141698.154734:0:6630:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783141698.154736:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141698.154751:0:6630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9464bfed19c0) 00000020:00000080:0.0:1783141698.154771:0:6630:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1783141698.154776:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783141698.154844:0:6630:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783141698.154855:0:6630:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783141698.154862:0:6630:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da89853d 00010000:00080000:0.0:1783141698.154889:0:6630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9464bfee7000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:0.0:1783141698.155098:0:6630:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1783141698.228661:0:6630:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783141698.228686:0:6630:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783141698.229199:0:6630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141698.229360:0:6630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141698.229733:0:6630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1783141698.229797:0:6630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1783141698.230366:0:6631:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783141698.230372:0:6631:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783141698.231191:0:6630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783141698.231204:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783141698.231235:0:6630:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783141698.231255:0:6630:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da898544 00000100:00080000:0.0:1783141698.231266:0:6630:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783141698.231271:0:6630:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9464bfee7000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1783141698.231304:0:6630:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496f80700 x1869759510488448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783141698.231333:0:6630:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1783141698.231524:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510488448:0@lo:8: 00000100:00100000:2.0:1783141698.231592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783141698.231723:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141698.231728:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141698.231730:0:6630:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783141698.231733:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141698.231737:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141698.231739:0:6630:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783141698.231742:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783141698.231744:0:6630:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783141698.231769:0:6630:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6630:1869759510488576:0@lo:502: 00000100:00100000:0.0:1783141698.231820:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141698.231835:0:6630:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486611840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141698.231893:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510488704:0@lo:400: 00000100:00100000:0.0:1783141698.231919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141698.231939:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141698.231944:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510488832:0@lo:400: 00000100:00100000:0.0:1783141698.231968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141698.232006:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510488704 00000100:00100000:0.0:1783141698.232013:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510488704 00000100:00100000:0.0:1783141698.232048:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510488832 00000100:00100000:0.0:1783141698.232051:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510488832 00000100:00100000:0.0:1783141698.232076:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141698.232084:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510488704:12345-0@lo:400: 00000100:00100000:0.0:1783141698.232137:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510488704:12345-0@lo:400: Request processed in 53us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141698.232144:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141698.232158:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141698.232164:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510488832:12345-0@lo:400: 00000100:00100000:0.0:1783141698.232193:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510488832:12345-0@lo:400: Request processed in 29us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141698.232198:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783141698.232220:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783141698.232244:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946496f82300 x1869759510488832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141698.232257:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510488832:0@lo:400: 00010000:00080000:0.0:1783141698.232268:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946496f83b80 x1869759510488704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141698.232288:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510488704:0@lo:400: 00000100:00100000:2.0:1783141698.232364:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510488576 00000100:00100000:2.0:1783141698.232369:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510488576 00000100:00100000:2.0:1783141698.232414:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783141698.232422:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:6630:x1869759510488576:12345-0@lo:502: 00000100:00100000:2.0:1783141698.232655:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:6630:x1869759510488576:12345-0@lo:502: Request processed in 233us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141698.232673:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783141698.235740:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510488448 00000100:00100000:1.0:1783141698.235754:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510488448 00000100:00100000:1.0:1783141698.235803:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141698.235810:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1869759510488448:12345-0@lo:8: 00010000:00080000:1.0:1783141698.235839:0:6584:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1783141698.235868:0:6584:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da89854b 00002000:00100000:1.0:1783141698.235907:0:6584:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff946381363800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783141698.235911:0:6584:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1783141698.235915:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1783141698.236025:0:6584:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783141698.236182:0:6584:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783141698.236210:0:6584:0:(import.c:65:import_set_state_nolock()) ffff946381366000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141698.236297:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1869759510488448:12345-0@lo:8: Request processed in 486us (4704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141698.236305:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783141698.236352:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff946496f80700 x1869759510488448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783141708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141698.236364:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783141698.236371:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783141698.236455:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783141698.236491:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783141698.236494:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9464bfee7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783141698.236501:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783141698.236507:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510488448:0@lo:8: 00000100:00100000:0.0:1783141698.236779:0:6630:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6630:1869759510488576:0@lo:502: 00000020:01000000:0.0:1783141698.236816:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141698.236823:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141698.236825:0:6630:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783141698.236828:0:6630:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:0.0:1783141698.238637:0:6631:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783141698.238771:0:6631:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 205443309857ns, next at 0ns, rc = 0 00000020:01000000:1.0:1783141698.238858:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1783141698.238884:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783141698.238895:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141698.238907:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141698.238916:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141698.238918:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946489ce7800 from 1 10000000:01000000:1.0:1783141698.238921:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141698.238956:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141698.238964:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141698.238989:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141698.239012:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510488960:0@lo:101: 00000100:00100000:1.0:1783141698.239071:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141698.239123:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488332780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141698.239971:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510488960 00000100:00100000:0.0:1783141698.239979:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510488960 00000100:00100000:0.0:1783141698.240015:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783141698.240024:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510488960:12345-0@lo:101: 00010000:00010000:0.0:1783141698.240039:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141698.240051:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898552 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.240077:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898552 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.240088:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898552 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.240098:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030400, rc 0) 00000100:00100000:0.0:1783141698.240147:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510488960:12345-0@lo:101: Request processed in 124us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141698.240154:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783141698.240336:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510488960:0@lo:101: 00010000:00010000:1.0:1783141698.240350:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141698.240359:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141698.240646:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510489088:0@lo:501: 00000100:00100000:1.0:1783141698.240673:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141698.240778:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488332780 going to sleep for 11 seconds 00000100:00100000:2.0:1783141698.242815:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510489088 00000100:00100000:2.0:1783141698.242827:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510489088 00000100:00100000:2.0:1783141698.242882:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783141698.242891:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510489088:12345-0@lo:501: 00000100:00100000:2.0:1783141698.243160:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510489088:12345-0@lo:501: Request processed in 269us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141698.243168:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783141698.243218:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510489088:0@lo:501: 00000100:00100000:2.0:1783141698.243265:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510489216:0@lo:503: 00000100:00100000:2.0:1783141698.243310:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141698.243339:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488331000 going to sleep for 11 seconds 00000100:00100000:2.0:1783141698.243353:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510489216 00000100:00100000:2.0:1783141698.243357:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510489216 00000100:00100000:0.0:1783141698.243755:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783141698.243771:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510489216:12345-0@lo:503: 00000100:00100000:0.0:1783141698.244061:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510489216:12345-0@lo:503: Request processed in 291us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141698.244069:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783141698.244226:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510489216:0@lo:503: 00000100:00100000:2.0:1783141698.246083:0:6633:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6633:1869759510489344:0@lo:502: 00000100:00100000:2.0:1783141698.246146:0:6633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141698.246184:0:6633:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488331d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141698.247104:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510489344 00000100:00100000:3.0:1783141698.247115:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510489344 00000100:00100000:3.0:1783141698.247152:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783141698.247160:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648762e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:6633:x1869759510489344:12345-0@lo:502: 00000100:00100000:3.0:1783141698.247402:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648762e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:6633:x1869759510489344:12345-0@lo:502: Request processed in 241us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141698.247409:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783141698.247677:0:6633:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6633:1869759510489344:0@lo:502: 00000020:01000000:2.0:1783141698.247711:0:6633:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141698.247720:0:6633:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141698.247722:0:6633:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783141698.247729:0:6633:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff946489ce7800 00000020:00000080:2.0:1783141698.247732:0:6633:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783141698.247766:0:6633:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6633:1869759510489472:0@lo:502: 00000100:00100000:2.0:1783141698.247806:0:6633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141698.247828:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510489472 00000100:00100000:2.0:1783141698.247832:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510489472 00000100:00100000:2.0:1783141698.247856:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783141698.247861:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648762d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+15:6633:x1869759510489472:12345-0@lo:502: 00000100:00100000:2.0:1783141698.247971:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648762d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+15:6633:x1869759510489472:12345-0@lo:502: Request processed in 108us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141698.247977:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783141698.248018:0:6633:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488331d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141698.248030:0:6633:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:6633:1869759510489472:0@lo:502: 00000020:01000000:2.0:1783141698.248047:0:6633:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141698.248051:0:6633:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141698.248053:0:6633:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783141698.248056:0:6633:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1783141698.259817:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783141698.259850:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783141698.259863:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.259876:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141698.259896:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783141698.259898:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff946482f299c0 from 1 10000000:01000000:3.0:1783141698.259901:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783141698.259935:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.259943:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.259953:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141698.259976:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510489600:0@lo:101: 00000100:00100000:3.0:1783141698.260038:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141698.260681:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141698.270539:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510489600 00000100:00100000:0.0:1783141698.270564:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510489600 00000100:00100000:0.0:1783141698.270713:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783141698.270723:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464851fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510489600:12345-0@lo:101: 00010000:00010000:0.0:1783141698.270739:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141698.270756:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898560 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.270782:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898560 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.270793:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898560 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141698.270801:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030000, rc 0) 00000100:00100000:0.0:1783141698.270870:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464851fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510489600:12345-0@lo:101: Request processed in 148us (10831us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141698.270876:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783141698.271038:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510489600:0@lo:101: 00010000:00010000:3.0:1783141698.271056:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.271066:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141698.271125:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510489728:0@lo:501: 00000100:00100000:3.0:1783141698.271155:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141698.271193:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141698.271534:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510489728 00000100:00100000:0.0:1783141698.271540:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510489728 00000100:00100000:0.0:1783141698.271581:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783141698.271589:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464851f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510489728:12345-0@lo:501: 00000100:00100000:0.0:1783141698.271806:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464851f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510489728:12345-0@lo:501: Request processed in 217us (650us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141698.271824:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141698.271999:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510489728:0@lo:501: 10000000:01000000:3.0:1783141698.272025:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783141698.272038:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141698.272047:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141698.276199:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783141698.292735:0:6632:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783141698.292769:0:6632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6632:1869759510489984:0@lo:7: 00000100:00100000:3.0:1783141698.292859:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141698.292911:0:6632:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141698.292936:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510489856:0@lo:13: 00000100:00100000:3.0:1783141698.292961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141698.293276:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510489984 00000100:00100000:2.0:1783141698.293284:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510489984 00000100:00100000:2.0:1783141698.293340:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141698.293350:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6632:x1869759510489984:12345-0@lo:7: 00000100:00080000:3.0:1783141698.293657:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1783141698.309019:0:6587:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783141698.309029:0:6587:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783141698.309293:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6632:x1869759510489984:12345-0@lo:7: Request processed in 15938us (16428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141698.309305:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141698.309350:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510489856 00000100:00100000:2.0:1783141698.309358:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510489856 00000100:00100000:2.0:1783141698.309407:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141698.309417:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510489856:12345-0@lo:13: 00002000:00000024:2.0:1783141698.309442:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1783141698.310141:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510489856:12345-0@lo:13: Request processed in 131us (16584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141698.310153:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783141698.310205:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946482f4dc00 x1869759510489856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141698.310227:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510489856:0@lo:13: 00010000:00080000:3.0:1783141698.311060:0:6632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946482f4d880 x1869759510489984/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783141714 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141698.311072:0:6632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6632:1869759510489984:0@lo:7: 00000004:00080000:3.0:1783141698.311083:0:6632:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1783141698.311702:0:6632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6632:1869759510490112:0@lo:5: 00000100:00100000:3.0:1783141698.311764:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141698.311825:0:6632:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141698.311894:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510490112 00000100:00100000:1.0:1783141698.311901:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510490112 00000100:00100000:1.0:1783141698.311951:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141698.311960:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6632:x1869759510490112:12345-0@lo:5: 00002000:00080000:1.0:1783141698.311987:0:6586:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783141698.311990:0:6586:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1783141698.312302:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6632:x1869759510490112:12345-0@lo:5: Request processed in 341us (536us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783141698.312309:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783141698.312344:0:6632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946482f4d880 x1869759510490112/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141714 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141698.312368:0:6632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6632:1869759510490112:0@lo:5: 00000004:00080000:1.0:1783141698.312390:0:6632:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783141698.312417:0:6632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d78000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6632:1869759510490240:0@lo:700: 00000100:00100000:1.0:1783141698.312446:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141698.312493:0:6632:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464883329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141698.312771:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510490240 00000100:00100000:2.0:1783141698.312777:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510490240 00000100:00100000:2.0:1783141698.312814:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141698.312822:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6632:x1869759510490240:12345-0@lo:700: 00000100:00100000:2.0:1783141698.312852:0:6593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6593:1869759510490368:0@lo:700: 00000100:00100000:2.0:1783141698.312897:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141698.312924:0:6593:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488331000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141698.313010:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510490368 00000100:00100000:3.0:1783141698.313015:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510490368 00000100:00100000:3.0:1783141698.313048:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141698.313055:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6593:x1869759510490368:12345-0@lo:700: 00000004:00080000:3.0:1783141698.366434:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1783141698.408614:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1783141698.415338:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6593:x1869759510490368:12345-0@lo:700: Request processed in 102274us (102432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141698.415358:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783141698.420828:0:6593:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946485192680 x1869759510490368/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783141714 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141698.420847:0:6593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6593:1869759510490368:0@lo:700: 40000000:02000000:2.0:1783141698.420861:0:6593:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1783141698.544820:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1783141698.544836:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783141698.545165:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6632:x1869759510490240:12345-0@lo:700: Request processed in 232339us (232713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141698.545200:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783141698.545272:0:6632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464b9d78000 x1869759510490240/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783141714 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141698.545283:0:6632:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783141698.545299:0:6632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d78000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6632:1869759510490240:0@lo:700: 00000004:02000040:3.0:1783141698.572081:0:6632:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1783141698.576195:0:6632:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6632:1869759510490496:0@lo:5: 00000100:00100000:3.0:1783141698.576265:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141698.576326:0:6632:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141698.576530:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510490496 00000100:00100000:2.0:1783141698.576539:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510490496 00000100:00100000:2.0:1783141698.576642:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141698.576652:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6632:x1869759510490496:12345-0@lo:5: 00002000:00080000:3.0:1783141698.585387:0:6587:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1783141698.585408:0:6587:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1783141698.591020:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6632:x1869759510490496:12345-0@lo:5: Request processed in 14364us (14748us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783141698.591036:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783141698.591129:0:6632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946482f4e300 x1869759510490496/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141714 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141698.591146:0:6632:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6632:1869759510490496:0@lo:5: 00000004:00080000:2.0:1783141698.591171:0:6632:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1783141699.291193:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141700.317624:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141701.341026:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141702.369626:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141703.386816:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141703.694996:0:6955:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783141703.706629:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141703.706655:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510491008:0@lo:400: 00000100:00100000:0.0:1783141703.706699:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510490752:0@lo:400: 00000100:00100000:2.0:1783141703.706734:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141703.706751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141703.706791:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510490624:0@lo:13: 00000100:00100000:0.0:1783141703.706797:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141703.706807:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510490880:0@lo:400: 00000100:00100000:2.0:1783141703.706830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141703.706839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141703.706852:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141703.706860:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510491136:0@lo:400: 00000100:00100000:2.0:1783141703.706895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141703.706912:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510491008 00000100:00100000:0.0:1783141703.706920:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510491008 00000100:00100000:2.0:1783141703.706928:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510490624 00000100:00100000:2.0:1783141703.706933:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510490624 00000100:00100000:2.0:1783141703.706979:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141703.706979:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510490880 00000100:00100000:0.0:1783141703.706985:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510490880 00000100:00100000:2.0:1783141703.706992:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510490624:12345-0@lo:13: 00000100:00100000:0.0:1783141703.707006:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141703.707015:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510491008:12345-0@lo:400: 00002000:00000024:2.0:1783141703.707026:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141703.707071:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510491008:12345-0@lo:400: Request processed in 57us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.707078:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141703.707093:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783141703.707101:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510490880:12345-0@lo:400: 00000100:00100000:0.0:1783141703.707137:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510490880:12345-0@lo:400: Request processed in 38us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.707144:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783141703.707179:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510490752 00000100:00100000:0.0:1783141703.707183:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510490752 00000100:00100000:0.0:1783141703.707283:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783141703.707292:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:3305:x1869759510490752:12345-0@lo:400: 00000100:00100000:0.0:1783141703.707329:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:3305:x1869759510490752:12345-0@lo:400: Request processed in 39us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141703.707336:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1783141703.707362:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141703.707368:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141703.708037:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510490624:12345-0@lo:13: Request processed in 1044us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141703.708046:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141703.708071:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510491136 00000100:00100000:2.0:1783141703.708076:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510491136 00000100:00100000:2.0:1783141703.708107:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141703.708114:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510491136:12345-0@lo:400: 00000100:00100000:2.0:1783141703.708152:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510491136:12345-0@lo:400: Request processed in 38us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141703.708158:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783141703.719400:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946496f83b80 x1869759510490880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141703.719567:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510490880:0@lo:400: 00000100:00100000:0.0:1783141703.719650:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510490752:0@lo:400: 00010000:00080000:0.0:1783141703.719700:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946496f81180 x1869759510491136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141703.719712:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510491136:0@lo:400: 00010000:00080000:0.0:1783141703.719724:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946496f82300 x1869759510491008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141703.719732:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510491008:0@lo:400: 00010000:00080000:0.0:1783141703.719741:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946485192680 x1869759510490624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141703.719755:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510490624:0@lo:13: 00000001:00080000:1.0:1783141703.805791:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1783141704.410739:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141705.436501:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141706.458653:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141707.483779:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141708.506892:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141708.827062:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510491264:0@lo:400: 00000100:00100000:0.0:1783141708.827132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141708.827164:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510491648:0@lo:400: 00000100:00100000:0.0:1783141708.827204:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141708.827206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141708.827213:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510491392:0@lo:400: 00000100:00100000:1.0:1783141708.827244:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141708.827249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141708.827254:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510491520:0@lo:400: 00000100:00100000:1.0:1783141708.827289:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141708.827291:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510491392 00000100:00100000:0.0:1783141708.827298:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510491392 00000100:00100000:0.0:1783141708.827339:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510491520 00000100:00100000:0.0:1783141708.827343:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510491520 00000100:00100000:1.0:1783141708.827362:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783141708.827452:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783141708.827478:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783141708.827491:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783141708.827499:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783141708.827505:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510491520:12345-0@lo:400: 00000100:00100000:0.0:1783141708.827557:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510491520:12345-0@lo:400: Request processed in 51us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141708.827563:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1783141708.827582:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141708.828430:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510491264 00000100:00100000:2.0:1783141708.828437:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510491264 00000100:00100000:0.0:1783141708.828443:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510491776:0@lo:13: 00000100:00100000:2.0:1783141708.828504:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783141708.828511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141708.828515:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:3305:x1869759510491264:12345-0@lo:400: 00000100:00100000:2.0:1783141708.828627:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:3305:x1869759510491264:12345-0@lo:400: Request processed in 116us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141708.828634:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783141708.828666:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510491776 00000100:00100000:2.0:1783141708.828670:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510491776 00000100:00100000:3.0:1783141708.828820:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510491648 00000100:00100000:3.0:1783141708.828824:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510491648 00000100:00100000:3.0:1783141708.828850:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141708.828857:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869759510491648:12345-0@lo:400: 00000100:00100000:0.0:1783141708.828883:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510491264:0@lo:400: 00000100:00100000:3.0:1783141708.828901:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1869759510491648:12345-0@lo:400: Request processed in 43us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141708.828908:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141708.829424:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141708.829436:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510491776:12345-0@lo:13: 00002000:00000024:2.0:1783141708.829485:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141708.829530:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510491776:12345-0@lo:13: Request processed in 97us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141708.829536:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141708.829873:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510491392:12345-0@lo:400: 00000100:00100000:1.0:1783141708.829913:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510491392:12345-0@lo:400: Request processed in 2543us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141708.829921:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783141708.829961:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946496f82a00 x1869759510491520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141708.829973:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510491520:0@lo:400: 00010000:00080000:1.0:1783141708.829999:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946496f83b80 x1869759510491648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141708.830007:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783141708.830021:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510491648:0@lo:400: 00000100:00080000:2.0:1783141708.832193:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783141708.834365:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946485191c00 x1869759510491776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141708.834392:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510491776:0@lo:13: 00010000:00080000:3.0:1783141708.834422:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946496f81180 x1869759510491392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141708.834432:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510491392:0@lo:400: 00010000:00010000:3.0:1783141709.530674:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141710.554993:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141711.582681:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141712.604027:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141713.628732:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141713.947668:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141713.947691:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510491904:0@lo:13: 00000100:00100000:3.0:1783141713.947759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141713.947917:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510491904 00000100:00100000:3.0:1783141713.947925:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510491904 00000100:00100000:3.0:1783141713.947973:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141713.947982:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510491904:12345-0@lo:13: 00002000:00000024:3.0:1783141713.948014:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141713.948057:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510491904:12345-0@lo:13: Request processed in 76us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141713.948064:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1783141713.948083:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783141713.948112:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946482f4c380 x1869759510491904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141713.948128:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510491904:0@lo:13: 00000100:00100000:1.0:1783141713.949231:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510492160:0@lo:400: 00000100:00100000:1.0:1783141713.949282:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141713.949309:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141713.949315:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510492032:0@lo:400: 00000100:00100000:1.0:1783141713.949342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141713.949636:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510492160 00000100:00100000:1.0:1783141713.949644:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510492160 00000100:00100000:1.0:1783141713.949677:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141713.949685:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510492160:12345-0@lo:400: 00000100:00100000:1.0:1783141713.949729:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510492160:12345-0@lo:400: Request processed in 44us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141713.949736:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141713.949755:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510492032 00000100:00100000:1.0:1783141713.949758:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510492032 00000100:00100000:1.0:1783141713.949780:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783141713.949786:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:3308:x1869759510492032:12345-0@lo:400: 00000100:00100000:1.0:1783141713.949815:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:3308:x1869759510492032:12345-0@lo:400: Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141713.949820:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783141713.949844:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141713.949854:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510492288:0@lo:400: 00000100:00100000:1.0:1783141713.949895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141713.950015:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510492032:0@lo:400: 00010000:00080000:1.0:1783141713.950034:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464b9d7a300 x1869759510492160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141713.950045:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510492160:0@lo:400: 00000100:00100000:3.0:1783141713.951241:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510492288 00000100:00100000:3.0:1783141713.951250:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510492288 00000100:00100000:3.0:1783141713.951313:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783141713.951323:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510492288:12345-0@lo:400: 00000100:00100000:3.0:1783141713.951399:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510492288:12345-0@lo:400: Request processed in 77us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141713.951406:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1783141713.951448:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464b9d7b480 x1869759510492288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783141713.951596:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141713.951648:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510492288:0@lo:400: 00000020:01000004:1.0:1783141714.466736:0:7486:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783141714.466740:0:7486:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1783141714.466877:0:7486:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff946381363000 00000020:01000004:1.0:1783141714.466893:0:7486:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783141714.466907:0:7486:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1783141714.466922:0:7486:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9464bab38000) 00000020:00000080:1.0:1783141714.466938:0:7486:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783141714.489300:0:7486:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783141714.489810:0:7486:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783141714.526736:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783141714.532721:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783141714.532749:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783141714.532800:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783141714.532821:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783141714.533111:0:7486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783141714.533122:0:7486:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783141714.533130:0:7486:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x279ffa91da898575 00000020:01000004:2.0:1783141714.533136:0:7486:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1783141714.533155:0:7486:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783141714.533159:0:7486:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783141714.533168:0:7486:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783141714.533186:0:7486:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1783141714.533189:0:7486:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783141714.570028:0:7486:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783141714.570064:0:7486:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.127@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1783141714.570068:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783141714.570070:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783141714.570071:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141714.570072:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141714.570073:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141714.570074:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141714.570076:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783141714.570077:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141714.570079:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141714.570080:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141714.570081:0:7486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783141714.570085:0:7486:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1783141714.570087:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783141714.570088:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783141714.570090:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141714.570091:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141714.570092:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141714.570093:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141714.570094:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783141714.570095:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141714.570095:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141714.570096:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141714.570097:0:7486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783141714.570124:0:7486:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783141714.570143:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510492416:0@lo:253: 00000100:00100000:3.0:1783141714.570207:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141714.571786:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510492416 00000100:00100000:3.0:1783141714.571797:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648682e600 going to sleep for 11 seconds 00000100:00100000:2.0:1783141714.571799:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510492416 00000100:00100000:2.0:1783141714.571850:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783141714.571859:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:7486:x1869759510492416:12345-0@lo:253: 20000000:01000000:2.0:1783141714.571889:0:5779:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783141714.571894:0:5779:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1783141714.571899:0:5779:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1783141714.571901:0:5779:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1783141714.573194:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141714.573424:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1783141714.573438:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1783141714.573677:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1783141714.573686:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1783141714.573715:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1783141714.573766:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1783141714.574147:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1783141714.574168:0:5779:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:2.0:1783141714.574170:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:2.0:1783141714.574202:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1783141714.574209:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783141714.574255:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1783141714.574263:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:2.0:1783141714.574296:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1783141714.574305:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783141714.574335:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1783141714.574401:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1783141714.577387:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1783141714.577423:0:5779:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.127@tcp 20000000:01000000:2.0:1783141714.577432:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.127@tcp (null) (null) (null) 00000040:00080000:2.0:1783141714.577626:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1783141714.577636:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783141714.577673:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1783141714.577681:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.127@tcp (null) (null) 00000040:00080000:2.0:1783141714.577709:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1783141714.577717:0:5779:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783141714.577800:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1783141714.577841:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1783141714.577862:0:5779:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783141714.577865:0:5779:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783141714.577868:0:5779:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783141714.577879:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783141714.577882:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783141714.577917:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783141714.577920:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783141714.583594:0:7488:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1783141714.583870:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1783141714.583930:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1783141714.584008:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1783141714.584022:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783141714.584025:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783141714.589200:0:7489:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1783141714.589282:0:7489:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1783141714.589370:0:7489:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1783141714.590317:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1783141714.590385:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1783141714.590451:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1783141714.591333:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783141714.591335:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783141714.592399:0:7490:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1783141714.592699:0:7490:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1783141714.593129:0:7490:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1783141714.593718:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1783141714.593975:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1783141714.594025:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1783141714.594044:0:5779:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783141714.594047:0:5779:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783141714.594865:0:7491:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1783141714.594935:0:7491:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1783141714.594985:0:7491:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1783141714.595225:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1783141714.595266:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1783141714.595403:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1783141714.595419:0:5779:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1783141714.595421:0:5779:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1783141714.595431:0:5779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783141714.597616:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597648:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2043400/0x279ffa91da8984bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8984b8 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597655:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8984e2 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597661:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89850c expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597667:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898528 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597673:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898560 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597680:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597719:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898560 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597733:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898560 expref: 16 pid: 5780 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.597749:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510492544:0@lo:104: 00000100:00100000:2.0:1783141714.597817:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141714.597869:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898528 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597878:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898528 expref: 16 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.597893:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510492672:0@lo:104: 00010000:00010000:2.0:1783141714.597920:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da89850c expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597928:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da89850c expref: 16 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.597936:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510492800:0@lo:104: 00010000:00010000:2.0:1783141714.597959:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8984e2 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.597967:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8984e2 expref: 16 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.597974:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510492928:0@lo:104: 00010000:00010000:2.0:1783141714.598013:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2043400/0x279ffa91da8984bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8984b8 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.598021:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464c2043400/0x279ffa91da8984bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8984b8 expref: 16 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.598028:0:5779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510493056:0@lo:104: 00000100:00100000:2.0:1783141714.598044:0:5779:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464972d6780 going to sleep for 11 seconds 00000100:00100000:3.0:1783141714.598540:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783141714.598560:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.598594:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.598602:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.598610:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.598620:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510492544 00000100:00100000:3.0:1783141714.598627:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510492544 00000100:00100000:3.0:1783141714.598661:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510492672 00000100:00100000:3.0:1783141714.598664:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510492672 00000100:00100000:3.0:1783141714.598675:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510492800 00000100:00100000:3.0:1783141714.598677:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510492800 00000100:00100000:3.0:1783141714.598685:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510492928 00000100:00100000:3.0:1783141714.598687:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510492928 00000100:00100000:3.0:1783141714.598694:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510493056 00000100:00100000:3.0:1783141714.598696:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510493056 00000100:00100000:3.0:1783141714.598708:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141714.598715:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946486939450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+7:5779:x1869759510492544:12345-0@lo:104: 00010000:00010000:3.0:1783141714.598728:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.598784:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783141714.598790:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946486939450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+7:5779:x1869759510492544:12345-0@lo:104: Request processed in 76us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141714.598797:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141714.598842:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141714.598850:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+6:5779:x1869759510492672:12345-0@lo:104: 00010000:00010000:3.0:1783141714.598858:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141714.598861:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510492544:0@lo:104: 00000100:00100000:1.0:1783141714.598914:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510492672:0@lo:104: 00010000:00010000:1.0:1783141714.598937:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783141714.598944:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+6:5779:x1869759510492672:12345-0@lo:104: Request processed in 95us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.598954:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783141714.598970:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141714.598976:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+5:5779:x1869759510492800:12345-0@lo:104: 00010000:00010000:1.0:1783141714.598985:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599024:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783141714.599030:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+5:5779:x1869759510492800:12345-0@lo:104: Request processed in 55us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.599035:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141714.599047:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783141714.599066:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+4:5779:x1869759510492928:12345-0@lo:104: 00010000:00010000:1.0:1783141714.599073:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599101:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783141714.599105:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+4:5779:x1869759510492928:12345-0@lo:104: Request processed in 41us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.599110:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783141714.599121:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141714.599127:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:5779:x1869759510493056:12345-0@lo:104: 00010000:00010000:1.0:1783141714.599133:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8984b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599158:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783141714.599163:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:5779:x1869759510493056:12345-0@lo:104: Request processed in 36us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.599168:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141714.599192:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510492800:0@lo:104: 00000100:00100000:1.0:1783141714.599200:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510492928:0@lo:104: 00000100:00100000:1.0:1783141714.599206:0:5779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1869759510493056:0@lo:104: 00010000:00010000:1.0:1783141714.599230:0:5779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.599561:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783141714.599567:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.599585:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174000 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:3.0:1783141714.599590:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.599598:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141714.599604:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141714.599610:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141714.599814:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599821:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141714.599833:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783141714.599855:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.599862:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1783141714.599865:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da898560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898567 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.599877:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510493184:0@lo:103: 00010000:00010000:1.0:1783141714.599882:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783141714.599886:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599893:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174400 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141714.599897:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599905:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141714.599912:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.599918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1783141714.599921:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141714.599941:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599948:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141714.599962:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599969:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da89850c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898513 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599982:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783141714.599990:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.599996:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141714.599999:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600005:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141714.600011:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141714.600017:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141714.600029:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600035:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141714.600040:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600046:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8984e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8984e9 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600055:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141714.600058:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8984b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600063:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031a00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141714.600066:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8984b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600082:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8984b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141714.600088:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8984b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141714.600094:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141714.600105:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8984b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600110:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783141714.600152:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510493312:0@lo:103: 00000100:00100000:0.0:1783141714.600180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141714.600200:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141714.600205:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510493440:0@lo:103: 00000100:00100000:0.0:1783141714.600224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141714.600251:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510493184 00000100:00100000:0.0:1783141714.600256:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510493184 00010000:00010000:0.0:1783141714.600277:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898560 expref: 17 pid: 5780 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141714.600297:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510493312 00000100:00100000:0.0:1783141714.600300:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510493312 00010000:00010000:0.0:1783141714.600310:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89850c expref: 18 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141714.600320:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510493440 00000100:00100000:0.0:1783141714.600322:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510493440 00010000:00010000:0.0:1783141714.600331:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8984e2 expref: 19 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141714.600343:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783141714.600349:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510493184:12345-0@lo:103: 00000100:00100000:3.0:1783141714.600366:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1783141714.600373:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783141714.600377:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510493568:0@lo:103: 00010000:00010000:0.0:1783141714.600389:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898560 expref: 19 pid: 5780 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141714.600401:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898560 expref: 19 pid: 5780 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141714.600411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783141714.600420:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480030000/0x279ffa91da898567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898560 expref: 19 pid: 5780 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141714.600435:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141714.600577:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510493568 00000100:00100000:3.0:1783141714.600582:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510493568 00010000:00010000:3.0:1783141714.600596:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2043400/0x279ffa91da8984bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8984b8 expref: 19 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141714.600636:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141714.600642:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510493312:12345-0@lo:103: 00010000:00010000:3.0:1783141714.600655:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141714.600660:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89850c expref: 19 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.600668:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da89850c expref: 19 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.600696:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a7200/0x279ffa91da898513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da89850c expref: 19 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.600707:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141714.600734:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+18:3307:x1869759510493312:12345-0@lo:103: Request processed in 92us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141714.600741:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141714.600758:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783141714.600764:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+17:3307:x1869759510493440:12345-0@lo:103: 00010000:00010000:3.0:1783141714.600772:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141714.600775:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8984b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.600778:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8984e2 expref: 17 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600793:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8984b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8984bf expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.600796:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8984e2 expref: 17 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600815:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141714.600818:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2174600/0x279ffa91da8984e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8984e2 expref: 17 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.600819:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141714.600822:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141714.600833:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141714.600836:0:6600:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1783141714.600845:0:6600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1783141714.600856:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+16:3307:x1869759510493440:12345-0@lo:103: Request processed in 92us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141714.600863:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783141714.600880:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783141714.600887:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+15:3306:x1869759510493568:12345-0@lo:103: 00010000:00010000:3.0:1783141714.600896:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141714.600900:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2043400/0x279ffa91da8984bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8984b8 expref: 15 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141714.600910:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510493440:0@lo:103: 00010000:00010000:3.0:1783141714.600918:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2043400/0x279ffa91da8984bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8984b8 expref: 15 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141714.600924:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510493312:0@lo:103: 00010000:00010000:3.0:1783141714.600932:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2043400/0x279ffa91da8984bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8984b8 expref: 15 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.600942:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141714.600981:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+14:3306:x1869759510493568:12345-0@lo:103: Request processed in 94us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141714.600987:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783141714.601037:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510493568:0@lo:103: 00000100:00100000:2.0:1783141714.602033:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510493184:0@lo:103: 00000100:00100000:0.0:1783141714.602034:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+13:3305:x1869759510493184:12345-0@lo:103: Request processed in 1680us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141714.602048:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783141714.603622:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141714.603626:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141714.603628:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141714.604954:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.604969:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030e00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141714.604974:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.604983:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141714.604990:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141714.604995:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141714.605048:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605054:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141714.605085:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605092:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da898528 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89852f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605112:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141714.605114:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141714.605116:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141714.605160:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510493696:0@lo:103: 00000100:00100000:1.0:1783141714.605222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141714.605313:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510493696 00000100:00100000:2.0:1783141714.605321:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510493696 00010000:00010000:2.0:1783141714.605348:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898528 expref: 13 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.605402:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783141714.605411:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+13:3306:x1869759510493696:12345-0@lo:103: 00010000:00010000:2.0:1783141714.605423:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141714.605429:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898528 expref: 13 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605440:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898528 expref: 13 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605454:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2175400/0x279ffa91da89852f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898528 expref: 13 pid: 5782 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605499:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605507:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605521:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605529:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605536:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.605542:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.606197:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141714.606202:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.606211:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.606370:0:5779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.606379:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783141714.606388:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1783141714.606440:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.606449:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0600/0x279ffa91da89857c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.606988:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141714.607043:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+12:3306:x1869759510493696:12345-0@lo:103: Request processed in 1631us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141714.607052:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141714.607209:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510493696:0@lo:103: 00010000:00010000:1.0:1783141714.650585:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141714.656689:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+11:7486:x1869759510492416:12345-0@lo:253: Request processed in 84820us (86470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141714.656705:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783141714.656817:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510492416:0@lo:253: 10000000:01000000:1.0:1783141714.656834:0:7486:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783141714.656837:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783141714.656839:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783141714.656840:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141714.656842:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783141714.656843:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141714.656844:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141714.656846:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783141714.656848:0:7486:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783141714.656849:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141714.656851:0:7486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783141714.656870:0:7486:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946381363000 from lustre-OST0001 10000000:01000000:1.0:1783141714.656919:0:7486:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783141714.656923:0:7486:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783141714.656932:0:7486:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff946482f299c0 local copy 10000000:01000000:1.0:1783141714.656936:0:7486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783141714.656977:0:7486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.656988:0:7486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.657005:0:7486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141714.657023:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510493824:0@lo:101: 00000100:00100000:1.0:1783141714.657060:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.657099:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141714.657162:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510493824 00000100:00100000:2.0:1783141714.657168:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510493824 00000100:00100000:2.0:1783141714.657211:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783141714.657219:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+11:7486:x1869759510493824:12345-0@lo:101: 00010000:00010000:2.0:1783141714.657230:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141714.657244:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a0600/0x279ffa91da89858a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898583 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.657384:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0600/0x279ffa91da89858a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898583 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.657396:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a0600/0x279ffa91da89858a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898583 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.657412:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0600, rc 0) 00000100:00100000:2.0:1783141714.657451:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510493824:12345-0@lo:101: Request processed in 232us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141714.657457:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783141714.657552:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510493824:0@lo:101: 00010000:00010000:1.0:1783141714.657566:0:7486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.657575:0:7486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141714.657683:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510493952:0@lo:501: 00000100:00100000:1.0:1783141714.657709:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.658007:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141714.658366:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510493952 00000100:00100000:0.0:1783141714.658372:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510493952 00000100:00100000:0.0:1783141714.658436:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783141714.658444:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510493952:12345-0@lo:501: 00000100:00100000:0.0:1783141714.658682:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510493952:12345-0@lo:501: Request processed in 238us (971us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141714.658689:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783141714.658781:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510493952:0@lo:501: 10000000:01000000:3.0:1783141714.658796:0:7486:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783141714.658824:0:7486:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783141714.658830:0:7486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.658839:0:7486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.658846:0:7486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.658871:0:7486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783141714.658892:0:7486:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946381363000 10000000:01000000:3.0:1783141714.658897:0:7486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783141714.658901:0:7486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783141714.658904:0:7486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783141714.658908:0:7486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783141714.658917:0:7486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783141714.658938:0:7486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.658946:0:7486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.658954:0:7486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141714.658967:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494080:0@lo:101: 00000100:00100000:3.0:1783141714.658994:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141714.659031:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141714.659037:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.659045:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a7400 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141714.659049:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.659057:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141714.659065:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141714.659071:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141714.659088:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.659094:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141714.659112:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.659119:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x279ffa91da89858a expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.659142:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141714.659144:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141714.659146:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141714.659157:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510494208:0@lo:103: 00000100:00100000:2.0:1783141714.659182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141714.659228:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510494208 00000100:00100000:2.0:1783141714.659233:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510494208 00000100:00100000:2.0:1783141714.659273:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141714.659280:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+12:3307:x1869759510494208:12345-0@lo:103: 00010000:00010000:2.0:1783141714.659290:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141714.659301:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0600/0x279ffa91da89858a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da898583 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.659314:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141714.659337:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+11:3307:x1869759510494208:12345-0@lo:103: Request processed in 59us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141714.659343:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141714.659377:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510494208:0@lo:103: 00000100:00100000:3.0:1783141714.659701:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141714.659767:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510494080 00000100:00100000:1.0:1783141714.659771:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510494080 00000100:00100000:1.0:1783141714.659793:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783141714.659798:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+11:7486:x1869759510494080:12345-0@lo:101: 00010000:00010000:1.0:1783141714.659808:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141714.659820:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898591 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.659836:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898591 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.659857:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898591 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.659864:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a7000, rc 0) 00000100:00100000:1.0:1783141714.659900:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494080:12345-0@lo:101: Request processed in 101us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.659906:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783141714.659984:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494080:0@lo:101: 00010000:00010000:3.0:1783141714.659997:0:7486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.660006:0:7486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141714.660075:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494336:0@lo:501: 00000100:00100000:3.0:1783141714.660109:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.660131:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141714.660177:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510494336 00000100:00100000:1.0:1783141714.660181:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510494336 00000100:00100000:1.0:1783141714.660197:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783141714.660203:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494336:12345-0@lo:501: 00000100:00100000:1.0:1783141714.660420:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494336:12345-0@lo:501: Request processed in 216us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.660427:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783141714.660559:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494336:0@lo:501: 00000100:00100000:3.0:1783141714.660587:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494464:0@lo:503: 00000100:00100000:3.0:1783141714.660622:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.660651:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141714.660701:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510494464 00000100:00100000:1.0:1783141714.660705:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510494464 00000100:00100000:1.0:1783141714.660724:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783141714.660730:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494464:12345-0@lo:503: 00000100:00100000:1.0:1783141714.660864:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494464:12345-0@lo:503: Request processed in 133us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.660870:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783141714.660946:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494464:0@lo:503: 00000040:00080000:3.0:1783141714.661191:0:7486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783141714.661370:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494592:0@lo:502: 00000100:00100000:3.0:1783141714.661405:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.661426:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141714.661486:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510494592 00000100:00100000:1.0:1783141714.661492:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510494592 00000100:00100000:1.0:1783141714.661512:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783141714.661519:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494592:12345-0@lo:502: 00000100:00100000:1.0:1783141714.661647:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494592:12345-0@lo:502: Request processed in 127us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.661660:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783141714.661844:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494592:0@lo:502: 00000040:00080000:3.0:1783141714.662086:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783141714.662136:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783141714.662172:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783141714.662233:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783141714.662284:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783141714.662314:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783141714.662337:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494720:0@lo:502: 00000100:00100000:3.0:1783141714.662387:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.662418:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141714.662531:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510494720 00000100:00100000:1.0:1783141714.662537:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510494720 00000100:00100000:1.0:1783141714.662561:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783141714.662567:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494720:12345-0@lo:502: 00000100:00100000:1.0:1783141714.662696:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494720:12345-0@lo:502: Request processed in 128us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.662704:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783141714.662803:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494720:0@lo:502: 00000040:00080000:3.0:1783141714.662881:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1783141714.662891:0:7486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1783141714.663269:0:7496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783141714.663277:0:7496:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1783141714.663283:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141714.663285:0:7496:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783141714.663292:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783141714.663314:0:7496:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9464972b4d40) 00000020:00000080:1.0:1783141714.663334:0:7496:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783141714.663341:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783141714.663404:0:7496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946381363000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783141714.663411:0:7496:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783141714.663417:0:7496:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x279ffa91da8985a6 00010000:00010000:1.0:1783141714.666303:0:7496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1783141714.669829:0:7496:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1783141714.672402:0:7496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783141714.672704:0:7496:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1783141714.676923:0:7496:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1783141714.677655:0:7496:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1783141714.678997:0:7496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783141714.679009:0:7496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141714.679015:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141714.679017:0:7496:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783141714.679027:0:7496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141714.679031:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141714.679032:0:7496:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783141714.679035:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783141714.679037:0:7496:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783141714.679083:0:7496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141714.679087:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141714.679089:0:7496:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783141714.679092:0:7496:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783141714.681024:0:7486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1783141714.681065:0:7486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783141714.681085:0:7486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141714.681098:0:7486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141714.681113:0:7486:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946381363000 from 1 10000000:01000000:0.0:1783141714.681116:0:7486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141714.681164:0:7486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141714.681173:0:7486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141714.681183:0:7486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141714.681204:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f81c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494848:0@lo:101: 00000100:00100000:0.0:1783141714.681380:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141714.681422:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141714.681517:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510494848 00000100:00100000:1.0:1783141714.681524:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510494848 00000100:00100000:1.0:1783141714.681562:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783141714.681571:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+12:7486:x1869759510494848:12345-0@lo:101: 00010000:00010000:1.0:1783141714.681585:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141714.681596:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8985ad expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.681619:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8985ad expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.681629:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8985ad expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.681638:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6000, rc 0) 00000100:00100000:1.0:1783141714.681679:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510494848:12345-0@lo:101: Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.681686:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783141714.683394:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f81c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494848:0@lo:101: 00010000:00010000:3.0:1783141714.683418:0:7486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.683429:0:7486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141714.683557:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494976:0@lo:501: 00000100:00100000:3.0:1783141714.683602:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.683637:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141714.683720:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510494976 00000100:00100000:0.0:1783141714.683727:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510494976 00000100:00100000:0.0:1783141714.683770:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783141714.683780:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510494976:12345-0@lo:501: 00000100:00100000:0.0:1783141714.684010:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510494976:12345-0@lo:501: Request processed in 230us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141714.684017:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783141714.684381:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510494976:0@lo:501: 00000100:00100000:3.0:1783141714.684411:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495104:0@lo:503: 00000100:00100000:3.0:1783141714.684448:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.684566:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141714.687333:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510495104 00000100:00100000:0.0:1783141714.687344:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510495104 00000100:00100000:0.0:1783141714.687432:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783141714.687442:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510495104:12345-0@lo:503: 00000100:00100000:0.0:1783141714.687752:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510495104:12345-0@lo:503: Request processed in 310us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141714.687769:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783141714.687964:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495104:0@lo:503: 00000040:00080000:1.0:1783141714.688786:0:7486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783141714.688860:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495232:0@lo:502: 00000100:00100000:1.0:1783141714.688923:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.688954:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141714.689026:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510495232 00000100:00100000:0.0:1783141714.689032:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510495232 00000100:00100000:0.0:1783141714.689072:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783141714.689081:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510495232:12345-0@lo:502: 00000100:00100000:0.0:1783141714.689482:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510495232:12345-0@lo:502: Request processed in 376us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141714.689490:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783141714.689598:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495232:0@lo:502: 00000040:00080000:1.0:1783141714.689839:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1783141714.689893:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1783141714.689920:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495360:0@lo:502: 00000100:00100000:1.0:1783141714.689958:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.690073:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141714.690127:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510495360 00000100:00100000:2.0:1783141714.690133:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510495360 00000100:00100000:2.0:1783141714.690210:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783141714.690219:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510495360:12345-0@lo:502: 00000100:00100000:2.0:1783141714.690376:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510495360:12345-0@lo:502: Request processed in 157us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141714.690383:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783141714.690553:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495360:0@lo:502: 00000040:00080000:1.0:1783141714.690633:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783141714.690643:0:7486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783141714.691082:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141714.691096:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141714.691099:0:7500:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783141714.691105:0:7500:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff946381363000 00000020:00000080:2.0:1783141714.691108:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783141714.691127:0:7500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141714.691130:0:7500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141714.691131:0:7500:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783141714.691134:0:7500:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783141714.691335:0:7486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783141714.691354:0:7486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141714.691383:0:7486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.691395:0:7486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141714.691447:0:7486:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783141714.691450:0:7486:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946381363000 10000000:01000000:1.0:1783141714.691453:0:7486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946381363000 10000000:01000000:1.0:1783141714.691456:0:7486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783141714.691486:0:7486:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff946381363000 from 1 10000000:01000000:1.0:1783141714.691489:0:7486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783141714.691518:0:7486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.691526:0:7486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.691542:0:7486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141714.691559:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495488:0@lo:101: 00000100:00100000:1.0:1783141714.691598:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.691624:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141714.691749:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510495488 00000100:00100000:2.0:1783141714.691755:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510495488 00000100:00100000:2.0:1783141714.691778:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783141714.691786:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510495488:12345-0@lo:101: 00010000:00010000:2.0:1783141714.691796:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141714.691808:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8985bb expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.691829:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8985bb expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.691839:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8985bb expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.691848:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0600, rc 0) 00000100:00100000:2.0:1783141714.691925:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510495488:12345-0@lo:101: Request processed in 139us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141714.691932:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783141714.692081:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495488:0@lo:101: 00010000:00010000:1.0:1783141714.692095:0:7486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.692105:0:7486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141714.692255:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495616:0@lo:501: 00000100:00100000:1.0:1783141714.692352:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.692417:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141714.692451:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510495616 00000100:00100000:2.0:1783141714.692456:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510495616 00000100:00100000:2.0:1783141714.692677:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783141714.692685:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510495616:12345-0@lo:501: 00000100:00100000:2.0:1783141714.692912:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510495616:12345-0@lo:501: Request processed in 227us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141714.692919:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783141714.692976:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495616:0@lo:501: 00000100:00100000:1.0:1783141714.693005:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495744:0@lo:503: 00000100:00100000:1.0:1783141714.693041:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.693116:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141714.693184:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510495744 00000100:00100000:3.0:1783141714.693190:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510495744 00000100:00100000:3.0:1783141714.693211:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783141714.693217:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510495744:12345-0@lo:503: 00000100:00100000:3.0:1783141714.693373:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510495744:12345-0@lo:503: Request processed in 155us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141714.693380:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783141714.693750:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495744:0@lo:503: 00000040:00080000:1.0:1783141714.693995:0:7486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783141714.694054:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495872:0@lo:502: 00000100:00100000:1.0:1783141714.694094:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.694123:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141714.694256:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510495872 00000100:00100000:3.0:1783141714.694272:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510495872 00000100:00100000:3.0:1783141714.694294:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783141714.694301:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510495872:12345-0@lo:502: 00000100:00100000:3.0:1783141714.694499:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510495872:12345-0@lo:502: Request processed in 196us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141714.694505:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783141714.694648:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510495872:0@lo:502: 00000040:00080000:1.0:1783141714.694898:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783141714.694949:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783141714.694999:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783141714.695057:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783141714.695097:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783141714.695159:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783141714.695197:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783141714.695232:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783141714.695303:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783141714.695342:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783141714.695390:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783141714.695441:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783141714.695515:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783141714.695553:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783141714.695601:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783141714.695637:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783141714.695669:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783141714.695717:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783141714.696028:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1783141714.696076:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1783141714.696152:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1783141714.696194:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1783141714.696229:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1783141714.696339:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1783141714.696391:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1783141714.696428:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1783141714.696507:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1783141714.696547:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1783141714.696581:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1783141714.696628:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1783141714.696664:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1783141714.696712:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1783141714.696745:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1783141714.696793:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1783141714.696846:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1783141714.696892:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1783141714.696927:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1783141714.696974:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510496000:0@lo:502: 00000100:00100000:1.0:1783141714.697045:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.697090:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141714.697248:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510496000 00000100:00100000:3.0:1783141714.697254:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510496000 00000100:00100000:3.0:1783141714.697304:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783141714.697314:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510496000:12345-0@lo:502: 00000100:00100000:3.0:1783141714.697546:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510496000:12345-0@lo:502: Request processed in 233us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141714.697553:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783141714.697717:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510496000:0@lo:502: 00000040:00080000:1.0:1783141714.697792:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1783141714.697804:0:7486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783141714.698529:0:7501:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783141714.698544:0:7501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff946482f2b380) 00000020:00000080:2.0:1783141714.698567:0:7501:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1783141714.698710:0:7501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946381363000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783141714.698714:0:7501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946381363000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783141714.698716:0:7501:0:(obd_mount.c:701:lustre_put_lsi()) put ffff946381363000 3 00010000:00080000:2.0:1783141714.698741:0:7501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9464b9d65800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.127@tcp at head 00010000:00010000:2.0:1783141714.703119:0:7501:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1783141714.706688:0:7501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783141714.706727:0:7501:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783141714.706755:0:7501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x279ffa91da8985d0 00000100:00080000:2.0:1783141714.706767:0:7501:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783141714.706773:0:7501:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9464b9d65800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141714.706806:0:7501:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946485190700 x1869759510496128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141714.706868:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1869759510496128:0@lo:38: 00000100:00100000:0.0:1783141714.706933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783141714.706988:0:7501:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783141714.707093:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510496128 00000100:00100000:1.0:1783141714.707102:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510496128 00000100:00100000:1.0:1783141714.707151:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783141714.707159:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1869759510496128:12345-0@lo:38: 00010000:00080000:1.0:1783141714.707182:0:5786:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1783141714.707215:0:5786:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x279ffa91da8985d7 00000004:00100000:1.0:1783141714.707230:0:5786:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783141714.707328:0:5786:0:(import.c:65:import_set_state_nolock()) ffff946497294000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141714.710341:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1869759510496128:12345-0@lo:38: Request processed in 3172us (3398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141714.710355:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1783141714.710594:0:7501:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1783141714.710720:0:7486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1783141714.710747:0:7486:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783141714.710776:0:7486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.710787:0:7486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783141714.710831:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783141714.710833:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783141714.710834:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141714.710835:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141714.710837:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141714.710838:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141714.710840:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783141714.710841:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141714.710842:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141714.710844:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141714.710845:0:7486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783141714.710849:0:7486:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1783141714.710851:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783141714.710853:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783141714.710854:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141714.710855:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141714.710856:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141714.710857:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141714.710858:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783141714.710859:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141714.710860:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141714.710861:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141714.710862:0:7486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783141714.710889:0:7486:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783141714.710905:0:7486:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510496256:0@lo:253: 00000100:00100000:3.0:1783141714.710969:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.711004:0:7486:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bb00dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141714.711022:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510496256 00000100:00100000:3.0:1783141714.711029:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510496256 00000100:00100000:3.0:1783141714.711061:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783141714.711075:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:7486:x1869759510496256:12345-0@lo:253: 20000000:01000000:3.0:1783141714.711109:0:5782:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783141714.711121:0:5782:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1783141714.711871:0:7503:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9464b9d7bb80 x1869759510496384/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141714.711883:0:7503:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f000 going to sleep for 0 seconds 00010000:00080000:0.0:1783141714.712281:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946485190700 x1869759510496128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141714.712293:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783141714.712302:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1783141714.712311:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783141714.712316:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783141714.712319:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9464b9d65800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1783141714.712326:0:3304:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006eee34a2): req@ffff9464b9d7bb80 x1869759510496384/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141714.712349:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1869759510496128:0@lo:38: 00000100:00100000:3.0:1783141714.712537:0:7503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141714.712557:0:7503:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f000 going to sleep for 11 seconds 00000100:00100000:0.0:1783141714.713275:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510496384 00000100:00100000:0.0:1783141714.713283:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510496384 00000100:00100000:0.0:1783141714.713343:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141714.713353:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7503:x1869759510496384:12345-0@lo:901: 00000100:00100000:0.0:1783141714.713760:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7503:x1869759510496384:12345-0@lo:901: Request processed in 407us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141714.713786:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783141714.713832:0:7503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9464b9d7bb80 x1869759510496384/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783141730 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141714.713845:0:7503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7503:1869759510496384:0@lo:901: 00000100:00080000:3.0:1783141714.714055:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1783141714.738977:0:5782:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783141714.738990:0:5782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783141714.739101:0:5802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783141714.739107:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783141714.739153:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.739172:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89851a expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.739180:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.739220:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da89851a expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.739234:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da89851a expref: 14 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141714.739249:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1869759510496512:0@lo:104: 00000100:00100000:1.0:1783141714.739424:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141714.739497:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141714.739565:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510496512 00000100:00100000:3.0:1783141714.739572:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510496512 00000100:00100000:3.0:1783141714.739623:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783141714.739634:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:5802:x1869759510496512:12345-0@lo:104: 00010000:00010000:3.0:1783141714.739646:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141714.739702:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783141714.739709:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:5802:x1869759510496512:12345-0@lo:104: Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141714.739716:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783141714.740813:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1869759510496512:0@lo:104: 00010000:00010000:1.0:1783141714.740841:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742307:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141714.742318:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742329:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141714.742333:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742367:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141714.742375:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141714.742380:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141714.742425:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742432:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141714.742457:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742490:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946480030800/0x279ffa91da89851a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898521 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742505:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141714.742507:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141714.742508:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141714.742529:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141714.742546:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510496640:0@lo:103: 00000100:00100000:2.0:1783141714.742608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141714.742655:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510496640 00000100:00100000:2.0:1783141714.742661:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510496640 00010000:00010000:2.0:1783141714.742686:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89851a expref: 15 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141714.742712:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141714.742720:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493c75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+15:3307:x1869759510496640:12345-0@lo:103: 00010000:00010000:2.0:1783141714.742740:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141714.742746:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89851a expref: 15 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742757:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da89851a expref: 15 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742771:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2042600/0x279ffa91da898521 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da89851a expref: 15 pid: 5779 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742785:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742792:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783141714.742805:0:5773:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004022317s 00010000:00010000:2.0:1783141714.742809:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742816:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742823:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742829:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742834:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a7800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141714.742838:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742852:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742863:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141714.742873:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141714.742906:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493c75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+14:3307:x1869759510496640:12345-0@lo:103: Request processed in 186us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141714.742913:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141714.742970:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510496640:0@lo:103: 00010000:00010000:1.0:1783141714.743188:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.743197:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141714.743203:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a7800/0x279ffa91da8985de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141714.752408:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+13:7486:x1869759510496256:12345-0@lo:253: Request processed in 41325us (41429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141714.752423:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783141714.752677:0:7486:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:872ec41a-f648-467b-b036-39669ac398c4:7486:1869759510496256:0@lo:253: 10000000:01000000:3.0:1783141714.752692:0:7486:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783141714.752696:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783141714.752698:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783141714.752700:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141714.752701:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141714.752702:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141714.752703:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141714.752704:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783141714.752706:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783141714.752707:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783141714.752709:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141714.752710:0:7486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783141714.752724:0:7486:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783141714.758426:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141714.758759:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783141714.758969:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141714.759135:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783141714.759497:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783141714.759710:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783141714.761420:0:7486:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783141714.986201:0:7486:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783141714.986210:0:7486:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783141714.986240:0:7486:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783141714.986302:0:7486:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783141714.986319:0:7486:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783141714.986337:0:7486:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1783141715.674632:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141716.699587:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141717.725718:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141718.747628:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141719.067026:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141719.067049:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510496768:0@lo:13: 00000100:00100000:1.0:1783141719.067111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141719.067216:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510496768 00000100:00100000:2.0:1783141719.067225:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510496768 00000100:00100000:2.0:1783141719.067284:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141719.067293:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510496768:12345-0@lo:13: 00002000:00000024:2.0:1783141719.067338:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783141719.067357:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141719.067393:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510496768:12345-0@lo:13: Request processed in 101us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141719.067400:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783141719.067482:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485191180 x1869759510496768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141719.067502:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510496768:0@lo:13: 00010000:00010000:3.0:1783141719.770690:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141720.096318:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510496896:0@lo:400: 00000100:00100000:1.0:1783141720.096401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141720.096457:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510497408:0@lo:400: 00000100:00100000:1.0:1783141720.096503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141720.096527:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141720.096533:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510497280:0@lo:400: 00000100:00100000:1.0:1783141720.096557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141720.096583:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510497152:0@lo:400: 00000100:00100000:1.0:1783141720.096607:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141720.096625:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783141720.096630:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510497024:0@lo:400: 00000100:00100000:1.0:1783141720.096651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141720.096677:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510496896 00000100:00100000:1.0:1783141720.096684:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510496896 00000100:00100000:1.0:1783141720.096731:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783141720.096740:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:3306:x1869759510496896:12345-0@lo:400: 00000100:00100000:1.0:1783141720.096791:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:3306:x1869759510496896:12345-0@lo:400: Request processed in 51us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141720.096799:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783141720.096833:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510497408 00000100:00100000:1.0:1783141720.096837:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510497408 00000100:00100000:1.0:1783141720.096865:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510497152 00000100:00100000:1.0:1783141720.096868:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510497152 00000100:00100000:1.0:1783141720.096902:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510497024 00000100:00100000:1.0:1783141720.096906:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510497024 00000100:00100000:1.0:1783141720.096921:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141720.096927:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510497408:12345-0@lo:400: 00000100:00100000:1.0:1783141720.096961:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510497408:12345-0@lo:400: Request processed in 34us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141720.096967:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141720.096979:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783141720.096987:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510497152:12345-0@lo:400: 00000100:00100000:1.0:1783141720.097020:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510497152:12345-0@lo:400: Request processed in 34us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141720.097025:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783141720.097037:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783141720.097043:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510497024:12345-0@lo:400: 00000100:00100000:1.0:1783141720.097070:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510497024:12345-0@lo:400: Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141720.097076:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1783141720.097092:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783141720.097118:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9d7b100 x1869759510497024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141720.097132:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510497024:0@lo:400: 00010000:00080000:1.0:1783141720.097142:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9d7ad80 x1869759510497152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141720.097150:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510497152:0@lo:400: 00000100:00100000:1.0:1783141720.097177:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510496896:0@lo:400: 00010000:00080000:1.0:1783141720.097199:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9d7b480 x1869759510497408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141720.097207:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510497408:0@lo:400: 00000100:00100000:3.0:1783141720.097375:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510497280 00000100:00100000:3.0:1783141720.097380:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510497280 00000100:00100000:3.0:1783141720.097408:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141720.097415:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510497280:12345-0@lo:400: 00000100:00100000:3.0:1783141720.097456:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510497280:12345-0@lo:400: Request processed in 41us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141720.097477:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783141720.098670:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9d79c00 x1869759510497280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141720.098686:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510497280:0@lo:400: 00010000:00010000:3.0:1783141720.795059:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783141721.292243:0:7846:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783141721.822501:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141722.842636:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141723.866622:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141724.188440:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510497536:0@lo:13: 00000100:00100000:2.0:1783141724.188523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.188644:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510497536 00000100:00100000:2.0:1783141724.188652:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510497536 00000100:00100000:2.0:1783141724.188701:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783141724.188710:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510497536:12345-0@lo:13: 00002000:00000024:2.0:1783141724.188756:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141724.188798:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510497536:12345-0@lo:13: Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141724.188805:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1783141724.188823:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783141724.188853:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485190000 x1869759510497536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141724.188870:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510497536:0@lo:13: 10000000:01000000:0.0:1783141724.188944:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783141724.188948:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff94649d28d000 from 30 10000000:01000000:0.0:1783141724.188951:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783141724.188993:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.189003:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.189023:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141724.189038:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510497664:0@lo:101: 00000100:00100000:0.0:1783141724.189071:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.189101:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1000 going to sleep for 11 seconds 00000100:00100000:1.0:1783141724.189284:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510497664 00000100:00100000:1.0:1783141724.189289:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510497664 00000100:00100000:1.0:1783141724.190306:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783141724.190322:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510497664:12345-0@lo:101: 00010000:00010000:1.0:1783141724.190336:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141724.190350:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8985e5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.190375:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8985e5 expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.190386:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8985e5 expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.190395:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6400, rc 0) 00000100:00100000:1.0:1783141724.190455:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510497664:12345-0@lo:101: Request processed in 139us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141724.190476:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783141724.190570:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510497664:0@lo:101: 00010000:00010000:0.0:1783141724.190587:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.190597:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141724.190651:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510497792:0@lo:501: 00000100:00100000:0.0:1783141724.190680:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.193382:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1000 going to sleep for 11 seconds 00000100:00100000:2.0:1783141724.194710:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510497792 00000100:00100000:2.0:1783141724.194724:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510497792 00000100:00100000:2.0:1783141724.194781:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783141724.194791:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510497792:12345-0@lo:501: 00000100:00100000:2.0:1783141724.195191:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510497792:12345-0@lo:501: Request processed in 400us (4510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141724.195198:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783141724.195625:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510497792:0@lo:501: 00000100:00100000:0.0:1783141724.195674:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510497920:0@lo:503: 00000100:00100000:0.0:1783141724.195722:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.195757:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1000 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.195772:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510497920 00000100:00100000:0.0:1783141724.195776:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510497920 00000100:00100000:0.0:1783141724.195799:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783141724.195806:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510497920:12345-0@lo:503: 00000100:00100000:0.0:1783141724.195943:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510497920:12345-0@lo:503: Request processed in 136us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.195956:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783141724.196007:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510497920:0@lo:503: 00000100:00100000:0.0:1783141724.196164:0:7951:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7951:1869759510498048:0@lo:502: 00000100:00100000:0.0:1783141724.196195:0:7951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.196212:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510498048 00000100:00100000:0.0:1783141724.196215:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510498048 00000100:00100000:0.0:1783141724.196231:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783141724.196236:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:7951:x1869759510498048:12345-0@lo:502: 00000100:00100000:0.0:1783141724.196536:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:7951:x1869759510498048:12345-0@lo:502: Request processed in 298us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.196543:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783141724.196578:0:7951:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.196590:0:7951:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7951:1869759510498048:0@lo:502: 00000100:00100000:0.0:1783141724.196628:0:7951:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7951:1869759510498176:0@lo:502: 00000100:00100000:0.0:1783141724.196658:0:7951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.196676:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510498176 00000100:00100000:0.0:1783141724.196679:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510498176 00000100:00100000:0.0:1783141724.196695:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783141724.196700:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:7951:x1869759510498176:12345-0@lo:502: 00000100:00100000:0.0:1783141724.196814:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:7951:x1869759510498176:12345-0@lo:502: Request processed in 113us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.196820:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783141724.196847:0:7951:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.196858:0:7951:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7951:1869759510498176:0@lo:502: 00000040:00080000:0.0:1783141724.196883:0:7951:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783141724.196930:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783141724.196945:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141724.196954:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.197945:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141724.197957:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783141724.197959:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1783141724.198033:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783141724.198066:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.198075:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.198084:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141724.198101:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510498304:0@lo:101: 00000100:00100000:0.0:1783141724.198144:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.198180:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.198200:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510498304 00000100:00100000:0.0:1783141724.198205:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510498304 00000100:00100000:0.0:1783141724.198231:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783141724.198238:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510498304:12345-0@lo:101: 00010000:00010000:0.0:1783141724.198249:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141724.198268:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8985f3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.198299:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8985f3 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.198310:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8985f3 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.198318:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480031000, rc 0) 00000100:00100000:0.0:1783141724.198446:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510498304:12345-0@lo:101: Request processed in 208us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.198453:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783141724.198505:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510498304:0@lo:101: 00010000:00010000:0.0:1783141724.198519:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.198528:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141724.198569:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510498432:0@lo:501: 00000100:00100000:0.0:1783141724.198590:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.198608:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.198617:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510498432 00000100:00100000:0.0:1783141724.198620:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510498432 00000100:00100000:0.0:1783141724.198635:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783141724.198640:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510498432:12345-0@lo:501: 00000100:00100000:0.0:1783141724.198844:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510498432:12345-0@lo:501: Request processed in 201us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.198863:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783141724.198892:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510498432:0@lo:501: 00000100:00100000:0.0:1783141724.198916:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510498560:0@lo:503: 00000100:00100000:0.0:1783141724.198949:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.198961:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464877dc300 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.199205:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510498560 00000100:00100000:0.0:1783141724.199209:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510498560 00000100:00100000:0.0:1783141724.199227:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783141724.199233:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510498560:12345-0@lo:503: 00000100:00100000:0.0:1783141724.199590:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510498560:12345-0@lo:503: Request processed in 356us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.199597:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783141724.199760:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510498560:0@lo:503: 00000100:00100000:2.0:1783141724.211808:0:7952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7952:1869759510498688:0@lo:502: 00000100:00100000:2.0:1783141724.211889:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.211937:0:7952:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.212128:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510498688 00000100:00100000:0.0:1783141724.212136:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510498688 00000100:00100000:0.0:1783141724.212181:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783141724.212190:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:7952:x1869759510498688:12345-0@lo:502: 00000100:00100000:0.0:1783141724.212501:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:7952:x1869759510498688:12345-0@lo:502: Request processed in 312us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.212510:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783141724.212706:0:7952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7952:1869759510498688:0@lo:502: 00000020:01000000:2.0:1783141724.212734:0:7952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141724.212744:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141724.212746:0:7952:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783141724.212751:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783141724.212753:0:7952:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783141724.212771:0:7952:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7952:1869759510498816:0@lo:502: 00000100:00100000:2.0:1783141724.212809:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.212838:0:7952:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141724.212876:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510498816 00000100:00100000:3.0:1783141724.212881:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510498816 00000100:00100000:3.0:1783141724.212914:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783141724.212921:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+15:7952:x1869759510498816:12345-0@lo:502: 00000100:00100000:3.0:1783141724.213065:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+15:7952:x1869759510498816:12345-0@lo:502: Request processed in 143us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141724.213071:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783141724.215222:0:7952:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7952:1869759510498816:0@lo:502: 00000020:01000000:2.0:1783141724.215268:0:7952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141724.215278:0:7952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141724.215281:0:7952:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783141724.215286:0:7952:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1783141724.215499:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1783141724.215520:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783141724.215531:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141724.215557:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141724.215569:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783141724.215572:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff946489ce7800 from 30 10000000:01000000:3.0:1783141724.215575:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783141724.215607:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141724.215615:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141724.215626:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141724.215643:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510498944:0@lo:101: 00000100:00100000:3.0:1783141724.215698:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141724.215740:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946383c64900 going to sleep for 11 seconds 00000100:00100000:1.0:1783141724.215798:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510498944 00000100:00100000:1.0:1783141724.215810:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510498944 00000100:00100000:1.0:1783141724.215854:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783141724.215862:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510498944:12345-0@lo:101: 00010000:00010000:1.0:1783141724.215874:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141724.215885:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898601 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.215908:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898601 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.215917:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898601 expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.215925:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6a00, rc 0) 00000100:00100000:1.0:1783141724.215977:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510498944:12345-0@lo:101: Request processed in 103us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141724.215984:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783141724.218565:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510498944:0@lo:101: 00010000:00010000:2.0:1783141724.218593:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141724.218605:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141724.218677:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499072:0@lo:501: 00000100:00100000:2.0:1783141724.218730:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.218776:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141724.218913:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510499072 00000100:00100000:1.0:1783141724.218920:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510499072 00000100:00100000:1.0:1783141724.218979:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783141724.218990:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510499072:12345-0@lo:501: 00000100:00100000:1.0:1783141724.219345:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510499072:12345-0@lo:501: Request processed in 355us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141724.219353:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783141724.219658:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499072:0@lo:501: 00000100:00100000:2.0:1783141724.219692:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499200:0@lo:503: 00000100:00100000:2.0:1783141724.219731:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.219765:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141724.219804:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510499200 00000100:00100000:3.0:1783141724.219809:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510499200 00000100:00100000:3.0:1783141724.219834:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783141724.219841:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510499200:12345-0@lo:503: 00000100:00100000:3.0:1783141724.220004:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510499200:12345-0@lo:503: Request processed in 163us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141724.220011:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783141724.220119:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499200:0@lo:503: 00000100:00100000:2.0:1783141724.220432:0:7953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7953:1869759510499328:0@lo:502: 00000100:00100000:2.0:1783141724.220496:0:7953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.220512:0:7953:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.220559:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510499328 00000100:00100000:0.0:1783141724.220564:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510499328 00000100:00100000:0.0:1783141724.220590:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783141724.220597:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:7953:x1869759510499328:12345-0@lo:502: 00000100:00100000:0.0:1783141724.220760:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:7953:x1869759510499328:12345-0@lo:502: Request processed in 163us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.220767:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783141724.220876:0:7953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7953:1869759510499328:0@lo:502: 00000100:00100000:2.0:1783141724.220917:0:7953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7953:1869759510499456:0@lo:502: 00000100:00100000:2.0:1783141724.220946:0:7953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.220982:0:7953:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.221070:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510499456 00000100:00100000:0.0:1783141724.221074:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510499456 00000100:00100000:0.0:1783141724.221102:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783141724.221108:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:7953:x1869759510499456:12345-0@lo:502: 00000100:00100000:0.0:1783141724.221237:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:7953:x1869759510499456:12345-0@lo:502: Request processed in 127us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.221243:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783141724.223131:0:7953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7953:1869759510499456:0@lo:502: 00000040:00080000:3.0:1783141724.223177:0:7953:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783141724.223392:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783141724.223412:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141724.223423:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.223433:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141724.223443:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783141724.223445:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff946489ce7800 from 5 10000000:01000000:0.0:1783141724.223448:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783141724.223504:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.223513:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.223523:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141724.223540:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499584:0@lo:101: 00000100:00100000:0.0:1783141724.223591:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.223624:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141724.224177:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510499584 00000100:00100000:1.0:1783141724.224186:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510499584 00000100:00100000:1.0:1783141724.224241:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783141724.224252:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510499584:12345-0@lo:101: 00010000:00010000:1.0:1783141724.224266:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141724.224300:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a7200/0x279ffa91da898616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89860f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.224325:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a7200/0x279ffa91da898616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89860f expref: 17 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.224349:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a7200/0x279ffa91da898616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89860f expref: 17 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.224359:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a7200, rc 0) 00000100:00100000:1.0:1783141724.224409:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510499584:12345-0@lo:101: Request processed in 158us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141724.224417:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783141724.224659:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499584:0@lo:101: 00010000:00010000:0.0:1783141724.224676:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.224685:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141724.224736:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499712:0@lo:256: 00000100:00100000:0.0:1783141724.224766:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.224799:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141724.224863:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510499712 00000100:00100000:3.0:1783141724.224868:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510499712 00000100:00100000:3.0:1783141724.224893:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783141724.224900:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510499712:12345-0@lo:256: 20000000:01000000:3.0:1783141724.224915:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783141724.224931:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783141724.224934:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783141724.225020:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510499712:12345-0@lo:256: Request processed in 119us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141724.225027:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783141724.225142:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499712:0@lo:256: 10000000:01000000:0.0:1783141724.225180:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783141724.225186:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.225194:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141724.225203:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783141724.225205:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1783141724.225208:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783141724.225226:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.225234:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.225242:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141724.225264:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499840:0@lo:101: 00000100:00100000:0.0:1783141724.225287:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.225317:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.225342:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510499840 00000100:00100000:0.0:1783141724.225346:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510499840 00000100:00100000:0.0:1783141724.225363:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783141724.225368:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510499840:12345-0@lo:101: 00010000:00010000:0.0:1783141724.225375:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141724.225384:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89861d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.225398:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89861d expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.225405:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89861d expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.225411:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030800, rc 0) 00000100:00100000:0.0:1783141724.225437:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510499840:12345-0@lo:101: Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.225443:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783141724.225490:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499840:0@lo:101: 00010000:00010000:0.0:1783141724.225500:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141724.225507:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141724.225559:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499968:0@lo:501: 00000100:00100000:0.0:1783141724.225583:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.225595:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.225604:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510499968 00000100:00100000:0.0:1783141724.225607:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510499968 00000100:00100000:0.0:1783141724.225623:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783141724.225629:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510499968:12345-0@lo:501: 00000100:00100000:0.0:1783141724.225875:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510499968:12345-0@lo:501: Request processed in 245us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.225882:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783141724.225909:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510499968:0@lo:501: 00000100:00100000:0.0:1783141724.225935:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510500096:0@lo:503: 00000100:00100000:0.0:1783141724.227133:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.227166:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.227191:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510500096 00000100:00100000:0.0:1783141724.227197:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510500096 00000100:00100000:0.0:1783141724.227234:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783141724.227242:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510500096:12345-0@lo:503: 00000100:00100000:0.0:1783141724.228261:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510500096:12345-0@lo:503: Request processed in 1013us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.228272:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783141724.229089:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510500096:0@lo:503: 00000100:00100000:0.0:1783141724.230066:0:7954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7954:1869759510500224:0@lo:502: 00000100:00100000:0.0:1783141724.230129:0:7954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.230224:0:7954:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783141724.240783:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510500224 00000100:00100000:1.0:1783141724.240799:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510500224 00000100:00100000:1.0:1783141724.240871:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783141724.240882:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:7954:x1869759510500224:12345-0@lo:502: 00000100:00100000:1.0:1783141724.241264:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:7954:x1869759510500224:12345-0@lo:502: Request processed in 383us (11134us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141724.241272:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783141724.242533:0:7954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7954:1869759510500224:0@lo:502: 00000020:01000000:0.0:1783141724.242582:0:7954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783141724.242589:0:7954:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783141724.242598:0:7954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141724.242600:0:7954:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783141724.242605:0:7954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783141724.242609:0:7954:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:0.0:1783141724.242632:0:7954:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783141724.242636:0:7954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141724.242652:0:7954:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9464bfed4d40) 00000020:00000080:0.0:1783141724.242672:0:7954:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1783141724.242677:0:7954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783141724.242759:0:7954:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783141724.242765:0:7954:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783141724.242771:0:7954:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da898632 00010000:00080000:0.0:1783141724.242799:0:7954:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946381370800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:0.0:1783141724.243024:0:7954:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1783141724.243357:0:7954:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1783141724.243368:0:7954:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783141724.243883:0:7954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141724.244087:0:7954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141724.244135:0:7954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1783141724.244192:0:7954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1783141724.252261:0:7955:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141724.252271:0:7955:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783141724.253695:0:7954:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783141724.253769:0:7954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783141724.253802:0:7954:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783141724.253825:0:7954:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da898639 00000100:00080000:0.0:1783141724.253835:0:7954:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783141724.253841:0:7954:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946381370800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1783141724.253873:0:7954:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496f80a80 x1869759510500352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141724.254062:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510500352:0@lo:8: 00000100:00100000:1.0:1783141724.254129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783141724.254323:0:7954:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783141724.254382:0:7954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141724.254387:0:7954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141724.254389:0:7954:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783141724.254392:0:7954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141724.254396:0:7954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141724.254397:0:7954:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783141724.254400:0:7954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783141724.254402:0:7954:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783141724.254425:0:7954:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7954:1869759510500480:0@lo:502: 00000100:00100000:0.0:1783141724.254493:0:7954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.254530:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510500480 00000100:00100000:0.0:1783141724.254537:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510500480 00000100:00100000:0.0:1783141724.254573:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783141724.254581:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:7954:x1869759510500480:12345-0@lo:502: 00000100:00100000:1.0:1783141724.254865:0:7954:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488331480 going to sleep for 11 seconds 00000100:00100000:3.0:1783141724.255388:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141724.255401:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510500608:0@lo:400: 00000100:00100000:3.0:1783141724.255440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141724.255484:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510500736:0@lo:400: 00000100:00100000:3.0:1783141724.255506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141724.255522:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141724.255528:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510500864:0@lo:400: 00000100:00100000:3.0:1783141724.255563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141724.255606:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510500608 00000100:00100000:3.0:1783141724.255611:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510500608 00000100:00100000:3.0:1783141724.255645:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510500736 00000100:00100000:3.0:1783141724.255648:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510500736 00000100:00100000:3.0:1783141724.255668:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510500864 00000100:00100000:3.0:1783141724.255670:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510500864 00000100:00100000:3.0:1783141724.255686:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783141724.255692:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510500608:12345-0@lo:400: 00000100:00100000:3.0:1783141724.255746:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510500608:12345-0@lo:400: Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141724.255753:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783141724.255776:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783141724.255781:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510500736:12345-0@lo:400: 00000100:00100000:3.0:1783141724.255811:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510500736:12345-0@lo:400: Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141724.255817:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783141724.255828:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783141724.255833:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510500864:12345-0@lo:400: 00000100:00100000:3.0:1783141724.255855:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510500864:12345-0@lo:400: Request processed in 22us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141724.255860:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783141724.258798:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783141724.258864:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946482f4ea00 x1869759510500608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141724.258880:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510500608:0@lo:400: 00010000:00080000:3.0:1783141724.258980:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946482f4ed80 x1869759510500864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141724.258989:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510500864:0@lo:400: 00010000:00080000:3.0:1783141724.259001:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946482f4dc00 x1869759510500736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141724.259008:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510500736:0@lo:400: 00000100:00100000:0.0:1783141724.259428:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:7954:x1869759510500480:12345-0@lo:502: Request processed in 4844us (4932us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.259438:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783141724.259735:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510500352 00000100:00100000:2.0:1783141724.259742:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510500352 00000100:00100000:2.0:1783141724.259775:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141724.259782:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1869759510500352:12345-0@lo:8: 00010000:00080000:2.0:1783141724.259808:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:2.0:1783141724.259833:0:6586:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da898640 00002000:00100000:2.0:1783141724.259845:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff946497222800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783141724.259849:0:6586:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1783141724.259853:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1783141724.260110:0:6586:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783141724.260369:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783141724.260395:0:6586:0:(import.c:65:import_set_state_nolock()) ffff946497225000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141724.260532:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1869759510500352:12345-0@lo:8: Request processed in 675us (6329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141724.260540:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783141724.260651:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496f80a80 x1869759510500352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783141734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141724.260661:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783141724.260668:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783141724.260677:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783141724.260683:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783141724.260686:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946381370800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783141724.260745:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783141724.260751:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510500352:0@lo:8: 00000004:00080000:2.0:1783141724.261009:0:7955:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783141724.261116:0:7955:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 231465655610ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783141724.262131:0:7954:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:7954:1869759510500480:0@lo:502: 00000020:01000000:1.0:1783141724.262183:0:7954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141724.262190:0:7954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141724.262212:0:7954:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783141724.262216:0:7954:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1783141724.262358:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1783141724.262374:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783141724.262384:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.262394:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141724.262402:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783141724.262405:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff946482f299c0 from 1 10000000:01000000:1.0:1783141724.262408:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783141724.262436:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.262444:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.262452:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141724.262487:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510500992:0@lo:101: 00000100:00100000:1.0:1783141724.262542:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141724.262576:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488331480 going to sleep for 11 seconds 00000100:00100000:1.0:1783141724.262604:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510500992 00000100:00100000:1.0:1783141724.262610:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510500992 00000100:00100000:1.0:1783141724.262650:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783141724.262658:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510500992:12345-0@lo:101: 00010000:00010000:1.0:1783141724.262670:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141724.262687:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898647 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.262717:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898647 expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.262727:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898647 expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.262736:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a7800, rc 0) 00000100:00100000:1.0:1783141724.262771:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510500992:12345-0@lo:101: Request processed in 113us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141724.262777:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783141724.262817:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510500992:0@lo:101: 00010000:00010000:1.0:1783141724.262829:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.262836:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141724.262878:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510501120:0@lo:501: 00000100:00100000:1.0:1783141724.263495:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141724.263515:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488331480 going to sleep for 11 seconds 00000100:00100000:1.0:1783141724.263532:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510501120 00000100:00100000:1.0:1783141724.263537:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510501120 00000100:00100000:1.0:1783141724.263564:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783141724.263571:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510501120:12345-0@lo:501: 00000100:00100000:1.0:1783141724.263789:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510501120:12345-0@lo:501: Request processed in 217us (294us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783141724.263806:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783141724.263842:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510501120:0@lo:501: 10000000:01000000:1.0:1783141724.263868:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783141724.263875:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141724.264104:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783141724.364890:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1783141724.472618:0:7956:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783141724.472648:0:7956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7956:1869759510501376:0@lo:7: 00000100:00100000:3.0:1783141724.472657:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510501248:0@lo:13: 00000100:00100000:3.0:1783141724.475634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.477687:0:7956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.477722:0:7956:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464877dc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141724.477767:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510501248 00000100:00100000:2.0:1783141724.477781:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510501248 00000100:00100000:3.0:1783141724.477856:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510501376 00000100:00100000:3.0:1783141724.477861:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510501376 00000100:00100000:3.0:1783141724.477890:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783141724.477908:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7956:x1869759510501376:12345-0@lo:7: 00000100:00100000:2.0:1783141724.478800:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783141724.478810:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1869759510501248:12345-0@lo:13: 00002000:00000024:2.0:1783141724.478895:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1783141724.478960:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1869759510501248:12345-0@lo:13: Request processed in 151us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141724.478967:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1783141724.479007:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783141724.479036:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485193480 x1869759510501248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141724.479055:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510501248:0@lo:13: 00002000:00080000:2.0:1783141724.491010:0:6584:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1783141724.491017:0:6584:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783141724.491175:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7956:x1869759510501376:12345-0@lo:7: Request processed in 13264us (13488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141724.491185:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783141724.491348:0:7956:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485190380 x1869759510501376/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783141740 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141724.491365:0:7956:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7956:1869759510501376:0@lo:7: 00000004:00080000:0.0:1783141724.491378:0:7956:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783141724.491628:0:7956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7956:1869759510501504:0@lo:5: 00000100:00100000:2.0:1783141724.491850:0:7956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141724.491924:0:7956:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464877dc780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141724.491966:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510501504 00000100:00100000:0.0:1783141724.491973:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510501504 00000100:00100000:0.0:1783141724.492049:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783141724.492057:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7956:x1869759510501504:12345-0@lo:5: 00002000:00080000:0.0:1783141724.492082:0:6586:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783141724.492085:0:6586:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783141724.492396:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7956:x1869759510501504:12345-0@lo:5: Request processed in 339us (546us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783141724.492415:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783141724.498502:0:7956:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496f80a80 x1869759510501504/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141740 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141724.498525:0:7956:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7956:1869759510501504:0@lo:5: 00000004:00080000:0.0:1783141724.498539:0:7956:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1783141724.498585:0:7956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f81f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7956:1869759510501632:0@lo:700: 00000100:00100000:0.0:1783141724.498643:0:7956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141724.498685:0:7956:0:(client.c:2701:ptlrpc_set_wait()) set ffff946490b33d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141724.498728:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510501632 00000100:00100000:3.0:1783141724.498736:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510501632 00000100:00100000:3.0:1783141724.498790:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141724.498799:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7956:x1869759510501632:12345-0@lo:700: 00000100:00100000:3.0:1783141724.498848:0:6593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6593:1869759510501760:0@lo:700: 00000100:00100000:3.0:1783141724.498876:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141724.498903:0:6593:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfd9e600 going to sleep for 11 seconds 00000100:00100000:2.0:1783141724.499115:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510501760 00000100:00100000:2.0:1783141724.499120:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510501760 00000100:00100000:2.0:1783141724.499151:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141724.499158:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6593:x1869759510501760:12345-0@lo:700: 40000000:02000000:0.0:1783141724.565246:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1783141724.572403:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6593:x1869759510501760:12345-0@lo:700: Request processed in 73237us (73517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141724.572417:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783141724.573206:0:6593:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649744df80 x1869759510501760/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783141740 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141724.573223:0:6593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6593:1869759510501760:0@lo:700: 40000000:02000000:3.0:1783141724.573238:0:6593:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1783141724.654893:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1783141724.654913:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783141724.655118:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7956:x1869759510501632:12345-0@lo:700: Request processed in 156315us (156471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141724.655129:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783141724.655304:0:7956:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496f81f80 x1869759510501632/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783141740 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141724.655332:0:7956:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783141724.655350:0:7956:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f81f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7956:1869759510501632:0@lo:700: 00000004:02000040:3.0:1783141724.708947:0:7956:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1783141724.713333:0:7956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7956:1869759510501888:0@lo:5: 00000100:00100000:3.0:1783141724.713405:0:7956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141724.713497:0:7956:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfd9e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141724.713751:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510501888 00000100:00100000:2.0:1783141724.713760:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510501888 00000100:00100000:2.0:1783141724.713815:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783141724.713824:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7956:x1869759510501888:12345-0@lo:5: 00002000:00080000:3.0:1783141724.720808:0:6584:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1783141724.720829:0:6584:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1783141724.724142:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7956:x1869759510501888:12345-0@lo:5: Request processed in 10313us (10731us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783141724.724154:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783141724.724377:0:7956:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649744df80 x1869759510501888/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783141740 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141724.724394:0:7956:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7956:1869759510501888:0@lo:5: 00000004:00080000:2.0:1783141724.724408:0:7956:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1783141724.892637:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141725.914640:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783141726.523257:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1783141726.938646:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141727.100943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141727.101215:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492653184 00000100:00100000:1.0:1783141727.101226:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492653184 00000100:00100000:1.0:1783141727.101344:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00100000:1.0:1783141727.101361:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2365:x1869759492653184:12345-192.168.203.27@tcp:250: 00010000:00080000:1.0:1783141727.101390:0:5780:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 1e3383e0-4c8b-465d-82d6-c67e2deecb1d@192.168.203.27@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:1.0:1783141727.101416:0:5780:0:(genops.c:1406:class_connect()) connect: client 1e3383e0-4c8b-465d-82d6-c67e2deecb1d, cookie 0x279ffa91da898655 00000100:00080000:1.0:1783141727.101571:0:5780:0:(import.c:65:import_set_state_nolock()) ffff946497296800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141727.101631:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+5:2365:x1869759492653184:12345-192.168.203.27@tcp:250: Request processed in 270us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141727.101639:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00100000:2.0:1783141727.105919:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141727.106803:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492653312 00000100:00100000:3.0:1783141727.106828:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492653312 00000100:00100000:3.0:1783141727.106894:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00100000:3.0:1783141727.106905:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+5:5566:x1869759492653312:12345-192.168.203.27@tcp:101: 00010000:00010000:3.0:1783141727.106921:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141727.106948:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fc81 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141727.106975:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc81 expref: 6 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141727.106987:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc81 expref: 6 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141727.106995:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175000, rc 0) 00000100:00100000:3.0:1783141727.107049:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+6:5566:x1869759492653312:12345-192.168.203.27@tcp:101: Request processed in 147us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141727.107067:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00100000:0.0:1783141727.120330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141727.120411:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492653440 00000100:00100000:1.0:1783141727.120421:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492653440 00000100:00100000:1.0:1783141727.120505:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 113 00000100:00100000:1.0:1783141727.120515:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+6:5566:x1869759492653440:12345-192.168.203.27@tcp:501: 00000100:00100000:1.0:1783141727.120863:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+6:5566:x1869759492653440:12345-192.168.203.27@tcp:501: Request processed in 349us (542us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783141727.120873:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 113 00000100:00100000:3.0:1783141727.126313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141727.126349:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492653568 00000100:00100000:3.0:1783141727.126360:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492653568 00000100:00100000:3.0:1783141727.126413:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:3.0:1783141727.126422:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+6:5566:x1869759492653568:12345-192.168.203.27@tcp:101: 00010000:00010000:3.0:1783141727.126648:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141727.126667:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fc88 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141727.126695:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc88 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141727.126719:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc88 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141727.126729:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175600, rc 0) 00000100:00100000:3.0:1783141727.126785:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+7:5566:x1869759492653568:12345-192.168.203.27@tcp:101: Request processed in 363us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141727.126793:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:0.0:1783141727.135139:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141727.135173:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492653696 00000100:00100000:0.0:1783141727.135181:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492653696 00000100:00100000:0.0:1783141727.135234:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:0.0:1783141727.135254:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+7:5566:x1869759492653696:12345-192.168.203.27@tcp:501: 00000100:00100000:0.0:1783141727.135710:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:5566:x1869759492653696:12345-192.168.203.27@tcp:501: Request processed in 465us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141727.135719:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:3.0:1783141727.138557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141727.139955:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492653824 00000100:00100000:0.0:1783141727.139969:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492653824 00000100:00100000:0.0:1783141727.140031:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:0.0:1783141727.140041:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:5566:x1869759492653824:12345-192.168.203.27@tcp:503: 00000100:00100000:0.0:1783141727.140427:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:5566:x1869759492653824:12345-192.168.203.27@tcp:503: Request processed in 387us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141727.140444:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:1.0:1783141727.155356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141727.159299:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492653952 00000100:00100000:2.0:1783141727.159314:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492653952 00000100:00100000:2.0:1783141727.159384:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 117 00000100:00100000:2.0:1783141727.159395:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:5584:x1869759492653952:12345-192.168.203.27@tcp:502: 00000100:00100000:2.0:1783141727.160446:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:5584:x1869759492653952:12345-192.168.203.27@tcp:502: Request processed in 1048us (5094us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141727.160457:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 117 00000100:00100000:3.0:1783141727.202680:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141727.204587:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492654080 00000100:00100000:1.0:1783141727.204601:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492654080 00000100:00100000:1.0:1783141727.204658:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 118 00000100:00100000:1.0:1783141727.204668:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:5584:x1869759492654080:12345-192.168.203.27@tcp:502: 00000100:00100000:1.0:1783141727.204934:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:5584:x1869759492654080:12345-192.168.203.27@tcp:502: Request processed in 266us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141727.204942:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 118 00000100:00100000:3.0:1783141727.211261:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141727.211378:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492654208 00000100:00100000:0.0:1783141727.211388:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492654208 00000100:00100000:0.0:1783141727.211438:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 119 00000100:00100000:0.0:1783141727.211448:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:5566:x1869759492654208:12345-192.168.203.27@tcp:101: 00010000:00010000:0.0:1783141727.211502:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141727.211520:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946480030a00/0x279ffa91da89866a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fcb2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141727.211557:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946480030a00/0x279ffa91da89866a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb2 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141727.211568:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946480030a00/0x279ffa91da89866a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb2 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141727.211586:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946480030a00, rc 0) 00000100:00100000:0.0:1783141727.211633:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5566:x1869759492654208:12345-192.168.203.27@tcp:101: Request processed in 186us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141727.211640:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 119 00000100:00100000:1.0:1783141727.214782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141727.214867:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492654336 00000100:00100000:3.0:1783141727.214877:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492654336 00000100:00100000:3.0:1783141727.214937:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:3.0:1783141727.214947:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5566:x1869759492654336:12345-192.168.203.27@tcp:256: 20000000:01000000:3.0:1783141727.214980:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783141727.215003:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783141727.215007:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783141727.215010:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783141727.215013:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1783141727.217340:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5566:x1869759492654336:12345-192.168.203.27@tcp:256: Request processed in 2384us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141727.217354:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:0.0:1783141727.223904:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141727.224075:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492654464 00000100:00100000:3.0:1783141727.224085:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492654464 00000100:00100000:3.0:1783141727.224135:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:3.0:1783141727.224145:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5566:x1869759492654464:12345-192.168.203.27@tcp:101: 00010000:00010000:3.0:1783141727.224162:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141727.224186:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fcb9 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141727.224230:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb9 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141727.224241:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb9 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141727.224249:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175400, rc 0) 00000100:00100000:3.0:1783141727.224312:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5566:x1869759492654464:12345-192.168.203.27@tcp:101: Request processed in 168us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141727.224320:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:0.0:1783141727.227706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141727.229309:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492654592 00000100:00100000:1.0:1783141727.229320:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492654592 00000100:00100000:1.0:1783141727.229375:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 122 00000100:00100000:1.0:1783141727.229384:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5566:x1869759492654592:12345-192.168.203.27@tcp:501: 00000100:00100000:0.0:1783141727.229736:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5566:x1869759492654592:12345-192.168.203.27@tcp:501: Request processed in 351us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141727.229746:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 122 00000100:00100000:0.0:1783141727.232624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141727.232674:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492654720 00000100:00100000:3.0:1783141727.232684:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492654720 00000100:00100000:3.0:1783141727.232734:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 123 00000100:00100000:3.0:1783141727.232744:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5566:x1869759492654720:12345-192.168.203.27@tcp:503: 00000100:00100000:3.0:1783141727.233259:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5566:x1869759492654720:12345-192.168.203.27@tcp:503: Request processed in 515us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141727.233278:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 123 00000100:00100000:0.0:1783141727.237206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141727.237240:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492654848 00000100:00100000:0.0:1783141727.237250:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492654848 00000100:00100000:0.0:1783141727.237308:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00100000:0.0:1783141727.237317:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648762e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5587:x1869759492654848:12345-192.168.203.27@tcp:502: 00000100:00100000:0.0:1783141727.237746:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648762e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5587:x1869759492654848:12345-192.168.203.27@tcp:502: Request processed in 428us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141727.237755:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00100000:3.0:1783141727.240402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141727.240660:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492654976 00000100:00100000:1.0:1783141727.240671:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492654976 00000100:00100000:1.0:1783141727.240755:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 125 00000100:00100000:1.0:1783141727.240766:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648762d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5587:x1869759492654976:12345-192.168.203.27@tcp:502: 00000100:00100000:1.0:1783141727.240998:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648762d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5587:x1869759492654976:12345-192.168.203.27@tcp:502: Request processed in 233us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141727.241006:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 125 00000100:00100000:0.0:1783141727.247411:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141727.248960:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492655104 00000100:00100000:3.0:1783141727.249030:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492655104 00000100:00100000:3.0:1783141727.249422:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:3.0:1783141727.249430:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2365:x1869759492655104:12345-192.168.203.27@tcp:38: 00010000:00080000:3.0:1783141727.249476:0:5786:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1783141727.249521:0:5786:0:(genops.c:1406:class_connect()) connect: client 8c7e4ac0-9090-4366-bd86-d237f38a8cf1, cookie 0x279ffa91da898678 00000004:00100000:3.0:1783141727.249559:0:5786:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1783141727.249572:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1783141727.273307:0:5786:0:(import.c:65:import_set_state_nolock()) ffff946497293000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141727.273382:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2365:x1869759492655104:12345-192.168.203.27@tcp:38: Request processed in 23950us (25979us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141727.273393:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00010000:00010000:2.0:1783141727.963600:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141728.278973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141728.279010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141728.279199:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492655232 00000100:00100000:0.0:1783141728.279209:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492655232 00000100:00100000:0.0:1783141728.279540:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492655360 00000100:00100000:0.0:1783141728.279557:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492655360 00000100:00100000:0.0:1783141728.279584:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:0.0:1783141728.279594:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:0:x1869759492655232:12345-192.168.203.27@tcp:41: 00000100:00100000:1.0:1783141728.279697:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1783141728.279706:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:5566:x1869759492655360:12345-192.168.203.27@tcp:41: 00000004:00000024:1.0:1783141728.279748:0:7171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783141728.279809:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:5566:x1869759492655360:12345-192.168.203.27@tcp:41: Request processed in 104us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141728.279817:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000004:00000024:0.0:1783141728.279876:0:5787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1783141728.279903:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:0:x1869759492655232:12345-192.168.203.27@tcp:41: Request processed in 310us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141728.279910:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00080000:2.0:1783141728.280106:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141728.283595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141728.283734:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492655488 00000100:00100000:0.0:1783141728.283744:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492655488 00000100:00100000:0.0:1783141728.283800:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:0.0:1783141728.283809:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:5566:x1869759492655488:12345-192.168.203.27@tcp:40: 00000100:00100000:0.0:1783141728.283892:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:5566:x1869759492655488:12345-192.168.203.27@tcp:40: Request processed in 83us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141728.283901:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1783141728.288600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141728.288688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141728.288718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141728.288983:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492655616 00000100:00100000:0.0:1783141728.288993:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492655616 00000100:00100000:0.0:1783141728.289033:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492655744 00000100:00100000:0.0:1783141728.289037:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492655744 00000100:00100000:0.0:1783141728.289051:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:0.0:1783141728.289059:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869759492655616:12345-192.168.203.27@tcp:8: 00010000:00080000:0.0:1783141728.289088:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1783141728.289117:0:6586:0:(genops.c:1406:class_connect()) connect: client 8c7e4ac0-9090-4366-bd86-d237f38a8cf1, cookie 0x279ffa91da89867f 00002000:00100000:0.0:1783141728.289129:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8c7e4ac0-9090-4366-bd86-d237f38a8cf1/ffff946381370000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783141728.289151:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783141728.289567:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783141728.289594:0:6586:0:(import.c:65:import_set_state_nolock()) ffff946381373800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141728.289666:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2365:x1869759492655616:12345-192.168.203.27@tcp:8: Request processed in 606us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141728.289673:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:0.0:1783141728.289691:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:0.0:1783141728.289696:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869759492655744:12345-192.168.203.27@tcp:8: 00010000:00080000:0.0:1783141728.289711:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1783141728.289726:0:6586:0:(genops.c:1406:class_connect()) connect: client 8c7e4ac0-9090-4366-bd86-d237f38a8cf1, cookie 0x279ffa91da898686 00002000:00100000:0.0:1783141728.289731:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8c7e4ac0-9090-4366-bd86-d237f38a8cf1/ffff946381376000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783141728.289745:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783141728.289932:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783141728.289947:0:6586:0:(import.c:65:import_set_state_nolock()) ffff946381374000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141728.289973:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2365:x1869759492655744:12345-192.168.203.27@tcp:8: Request processed in 275us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141728.289979:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:1.0:1783141728.291687:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492655872 00000100:00100000:1.0:1783141728.291701:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492655872 00000100:00100000:1.0:1783141728.291755:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:1.0:1783141728.291764:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:5566:x1869759492655872:12345-192.168.203.27@tcp:33: 00000100:00100000:0.0:1783141728.293420:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141728.293614:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492656000 00000100:00100000:1.0:1783141728.293623:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492656000 00000100:00100000:1.0:1783141728.293671:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:1.0:1783141728.293681:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464851fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2369:x1869759492656000:12345-192.168.203.27@tcp:400: 00000100:00100000:1.0:1783141728.293751:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464851fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2369:x1869759492656000:12345-192.168.203.27@tcp:400: Request processed in 72us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141728.293759:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 126 00000004:00080000:1.0:1783141728.310538:0:5789:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18632us 00000004:00200000:1.0:1783141728.321635:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1783141728.321798:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:5566:x1869759492655872:12345-192.168.203.27@tcp:33: Request processed in 30029us (33202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141728.321808:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:0.0:1783141728.505552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141728.505647:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492656128 00000100:00100000:1.0:1783141728.505657:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492656128 00000100:00100000:1.0:1783141728.505720:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:1.0:1783141728.505729:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:5605:x1869759492656128:12345-192.168.203.27@tcp:101: 00010000:00010000:1.0:1783141728.505747:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141728.505835:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6e00/0x279ffa91da89868d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fce3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141728.505904:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da898694 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141728.505917:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da898694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141728.505930:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da898694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141728.506190:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783141728.506194:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141728.506279:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da898694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141728.506310:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6e00/0x279ffa91da89868d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fce3 expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141728.506328:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da898694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fce3 expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141728.506335:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:1.0:1783141728.506338:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141728.506341:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6200, rc 0) 00000100:00100000:1.0:1783141728.506778:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:5605:x1869759492656128:12345-192.168.203.27@tcp:101: Request processed in 1048us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141728.506785:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00010000:00010000:0.0:1783141728.986703:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141729.307240:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510502400:0@lo:400: 00000100:00100000:1.0:1783141729.307317:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510502016:0@lo:400: 00000100:00100000:0.0:1783141729.307319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141729.307370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141729.307395:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510502528:0@lo:400: 00000100:00100000:0.0:1783141729.307406:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510502016 00000100:00100000:0.0:1783141729.307414:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510502016 00000100:00100000:1.0:1783141729.307421:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141729.307457:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510502528 00000100:00100000:0.0:1783141729.307474:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783141729.307476:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510502528 00000100:00100000:0.0:1783141729.307483:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464851f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510502016:12345-0@lo:400: 00000100:00100000:1.0:1783141729.307511:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783141729.307517:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510502528:12345-0@lo:400: 00000100:00100000:0.0:1783141729.307534:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464851f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510502016:12345-0@lo:400: Request processed in 52us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141729.307541:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783141729.307544:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510502528:12345-0@lo:400: Request processed in 28us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141729.307550:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141729.307591:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510502016:0@lo:400: 00000100:00100000:0.0:1783141729.307605:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510502528:0@lo:400: 00000100:00100000:2.0:1783141729.307737:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510502400 00000100:00100000:2.0:1783141729.307741:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510502400 00000100:00100000:2.0:1783141729.307779:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141729.307786:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510502400:12345-0@lo:400: 00000100:00100000:2.0:1783141729.307831:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510502400:12345-0@lo:400: Request processed in 46us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141729.307838:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1783141729.307853:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141729.307857:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783141729.307991:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485192680 x1869759510502400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141729.308012:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510502400:0@lo:400: 00000100:00100000:1.0:1783141729.308040:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510502144:0@lo:400: 00000100:00100000:1.0:1783141729.308064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141729.308091:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510502656:0@lo:400: 00000100:00100000:1.0:1783141729.308124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141729.308148:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141729.308154:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510502272:0@lo:400: 00000100:00100000:0.0:1783141729.308539:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510502144 00000100:00100000:0.0:1783141729.308544:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510502144 00000100:00100000:0.0:1783141729.308583:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141729.308590:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510502144:12345-0@lo:400: 00000100:00100000:3.0:1783141729.308597:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510502784:0@lo:13: 00000100:00100000:3.0:1783141729.308622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141729.308624:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510502144:12345-0@lo:400: Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141729.308630:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783141729.308750:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510502784 00000100:00100000:2.0:1783141729.308755:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510502784 00000100:00100000:2.0:1783141729.308787:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783141729.308794:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510502784:12345-0@lo:13: 00002000:00000024:2.0:1783141729.308807:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141729.308847:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510502784:12345-0@lo:13: Request processed in 53us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141729.308853:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783141729.308869:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510502656 00000100:00100000:2.0:1783141729.308872:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510502656 00000100:00100000:2.0:1783141729.308899:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141729.308905:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510502656:12345-0@lo:400: 00000100:00100000:2.0:1783141729.308934:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510502656:12345-0@lo:400: Request processed in 29us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141729.308939:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1783141729.308951:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783141729.309081:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649744d500 x1869759510502784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141729.309097:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510502784:0@lo:13: 00000100:00100000:1.0:1783141729.309623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141729.309659:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510502144:0@lo:400: 00010000:00080000:1.0:1783141729.309671:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485190e00 x1869759510502656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141729.309679:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783141729.309689:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510502656:0@lo:400: 00000100:00100000:0.0:1783141729.310571:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510502272 00000100:00100000:0.0:1783141729.310579:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510502272 00000100:00100000:0.0:1783141729.310645:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783141729.310653:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510502272:12345-0@lo:400: 00000100:00100000:0.0:1783141729.310713:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510502272:12345-0@lo:400: Request processed in 60us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141729.310719:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1783141729.310865:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141729.311637:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510502272:0@lo:400: 00000100:00100000:0.0:1783141729.818688:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141729.818714:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510502912:0@lo:13: 00000100:00100000:0.0:1783141729.818786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141729.819130:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510502912 00000100:00100000:2.0:1783141729.819139:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510502912 00000100:00100000:2.0:1783141729.819196:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141729.819219:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510502912:12345-0@lo:13: 00002000:00000024:2.0:1783141729.819308:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141729.819370:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510502912:12345-0@lo:13: Request processed in 152us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141729.819378:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1783141729.819583:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485191f80 x1869759510502912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141729.819605:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510502912:0@lo:13: 00010000:00010000:2.0:1783141730.012887:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783141730.375304:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000100:00100000:1.0:1783141730.501709:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141730.501895:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492656256 00000100:00100000:0.0:1783141730.501905:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492656256 00000100:00100000:0.0:1783141730.501982:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:0.0:1783141730.501993:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:5657:x1869759492656256:12345-192.168.203.27@tcp:41: 00000004:00000024:0.0:1783141730.502037:0:5787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1783141730.502105:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:5657:x1869759492656256:12345-192.168.203.27@tcp:41: Request processed in 114us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141730.502130:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00080000:2.0:1783141730.503536:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141730.510788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141730.511184:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492656384 00000100:00100000:2.0:1783141730.511198:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492656384 00000100:00100000:2.0:1783141730.511318:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00080000:0.0:1783141730.511500:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141730.511592:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:5657:x1869759492656384:12345-192.168.203.27@tcp:13: 00002000:00000024:2.0:1783141730.511645:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141730.511750:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:5657:x1869759492656384:12345-192.168.203.27@tcp:13: Request processed in 164us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141730.519795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141730.524712:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1783141730.524734:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1783141730.525312:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492656512 00000100:00100000:0.0:1783141730.525323:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492656512 00000100:00080000:3.0:1783141730.525601:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141730.525625:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:1.0:1783141730.525648:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:5657:x1869759492656512:12345-192.168.203.27@tcp:13: 00002000:00000024:1.0:1783141730.525684:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141730.525789:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:5657:x1869759492656512:12345-192.168.203.27@tcp:13: Request processed in 150us (6007us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141730.525798:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:2.0:1783141730.529314:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00010000:00010000:2.0:1783141731.037214:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141732.058856:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783141732.428426:0:5809:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000001:00100000:2.0:1783141732.956629:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00010000:00010000:3.0:1783141733.084043:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783141733.171176:0:8160:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1783141733.595199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141733.595251:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141733.595288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141733.595322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141733.595353:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492656896 00000100:00100000:3.0:1783141733.595362:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492656896 00000100:00100000:3.0:1783141733.595414:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492657024 00000100:00100000:3.0:1783141733.595417:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492657024 00000100:00100000:3.0:1783141733.595454:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:3.0:1783141733.595499:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2368:x1869759492656896:12345-192.168.203.27@tcp:400: 00000100:00100000:3.0:1783141733.595569:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2368:x1869759492656896:12345-192.168.203.27@tcp:400: Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141733.595577:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:3.0:1783141733.595594:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:3.0:1783141733.595600:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2368:x1869759492657024:12345-192.168.203.27@tcp:400: 00000100:00100000:3.0:1783141733.595621:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2368:x1869759492657024:12345-192.168.203.27@tcp:400: Request processed in 22us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141733.595627:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00080000:3.0:1783141733.595641:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141733.595645:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141733.595825:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492656768 00000100:00100000:2.0:1783141733.595830:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492656768 00000100:00100000:2.0:1783141733.595879:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:2.0:1783141733.595886:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492656768:12345-192.168.203.27@tcp:400: 00000100:00100000:2.0:1783141733.595924:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492656768:12345-192.168.203.27@tcp:400: Request processed in 38us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141733.595931:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:0.0:1783141733.596102:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492656640 00000100:00100000:0.0:1783141733.596107:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492656640 00000100:00100000:0.0:1783141733.596144:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00100000:0.0:1783141733.596152:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2368:x1869759492656640:12345-192.168.203.27@tcp:400: 00000100:00100000:0.0:1783141733.596192:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2368:x1869759492656640:12345-192.168.203.27@tcp:400: Request processed in 42us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141733.596199:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00080000:3.0:1783141733.596990:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783141734.106714:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141734.427653:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510503040:0@lo:13: 00000100:00100000:3.0:1783141734.428862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141734.429070:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510503040 00000100:00100000:0.0:1783141734.429082:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510503040 00000100:00100000:0.0:1783141734.429906:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783141734.429925:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510503040:12345-0@lo:13: 00002000:00000024:0.0:1783141734.429980:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141734.430070:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510503040:12345-0@lo:13: Request processed in 153us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141734.430078:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1783141734.431901:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783141734.431997:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649744ca80 x1869759510503040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141734.432027:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510503040:0@lo:13: 00000100:00100000:3.0:1783141734.433424:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510503168:0@lo:400: 00000100:00100000:3.0:1783141734.433550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141734.433608:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510503680:0@lo:400: 00000100:00100000:3.0:1783141734.433638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141734.433668:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141734.433674:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510503296:0@lo:400: 00000100:00100000:3.0:1783141734.433716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141734.434259:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510503168 00000100:00100000:0.0:1783141734.434270:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510503168 00000100:00100000:0.0:1783141734.434406:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783141734.434417:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510503168:12345-0@lo:400: 00000100:00100000:0.0:1783141734.435436:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510503168:12345-0@lo:400: Request processed in 1013us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141734.435472:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783141734.436277:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510503168:0@lo:400: 00000100:00100000:3.0:1783141734.436939:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510503424:0@lo:400: 00000100:00100000:3.0:1783141734.437009:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141734.437053:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141734.437063:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510503552:0@lo:400: 00000100:00100000:3.0:1783141734.437084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141734.437229:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510503296 00000100:00100000:0.0:1783141734.437239:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510503296 00000100:00100000:3.0:1783141734.437372:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510503680 00000100:00100000:3.0:1783141734.437377:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510503680 00000100:00100000:3.0:1783141734.437421:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141734.437431:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510503680:12345-0@lo:400: 00000100:00100000:3.0:1783141734.437514:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510503680:12345-0@lo:400: Request processed in 84us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141734.437521:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141734.437547:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510503424 00000100:00100000:3.0:1783141734.437551:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510503424 00000100:00100000:3.0:1783141734.437569:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510503552 00000100:00100000:3.0:1783141734.437571:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510503552 00000100:00100000:3.0:1783141734.437585:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783141734.437591:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510503296:12345-0@lo:400: 00000100:00100000:3.0:1783141734.437622:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510503296:12345-0@lo:400: Request processed in 30us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141734.437628:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783141734.437640:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783141734.437645:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510503424:12345-0@lo:400: 00000100:00100000:3.0:1783141734.437677:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510503424:12345-0@lo:400: Request processed in 32us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141734.437700:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783141734.437712:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783141734.437718:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510503552:12345-0@lo:400: 00000100:00100000:3.0:1783141734.439923:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510503552:12345-0@lo:400: Request processed in 2190us (2822us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141734.439940:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1783141734.440015:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141734.440021:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141734.440075:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510503552:0@lo:400: 00000100:00100000:3.0:1783141734.440091:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510503424:0@lo:400: 00000100:00100000:3.0:1783141734.441476:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510503296:0@lo:400: 00010000:00080000:3.0:1783141734.441500:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496f82300 x1869759510503680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141734.441512:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510503680:0@lo:400: 00000100:00100000:3.0:1783141734.942559:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510503808:0@lo:13: 00000100:00100000:3.0:1783141734.942657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141734.942976:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510503808 00000100:00100000:0.0:1783141734.942987:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510503808 00000100:00100000:0.0:1783141734.943051:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783141734.943062:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510503808:12345-0@lo:13: 00002000:00000024:0.0:1783141734.943111:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141734.946065:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510503808:12345-0@lo:13: Request processed in 2992us (3397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141734.946084:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1783141734.950622:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496f82300 x1869759510503808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141734.950671:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510503808:0@lo:13: 00010000:00010000:0.0:1783141735.133016:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141736.155598:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783141736.865061:0:8307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3f855500 20000000:00000080:0.0:1783141736.865085:0:8307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff946496a1b800 uarg=0000000000000000 20000000:01000000:0.0:1783141736.865135:0:8307:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1783141736.865138:0:8307:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1783141736.865142:0:8307:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1783141736.865147:0:8307:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1783141736.865154:0:8307:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1783141736.865173:0:8307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783141736.865176:0:8307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783141736.867080:0:8307:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783141736.867088:0:8307:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783141736.868436:0:8308:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1783141736.869405:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1783141736.869621:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1783141736.869664:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1783141736.869680:0:8307:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783141736.869683:0:8307:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783141736.870816:0:8309:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1783141736.871446:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1783141736.874093:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1783141736.874288:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1783141736.874312:0:8307:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783141736.874316:0:8307:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783141736.875424:0:8310:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1783141736.876126:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1783141736.876179:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1783141736.876228:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1783141736.876245:0:8307:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783141736.876248:0:8307:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783141736.877092:0:8311:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1783141736.877790:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1783141736.877860:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1783141736.877894:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1783141736.877909:0:8307:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783141736.877933:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.877956:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898591 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.877964:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8985bb expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.877972:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8985e5 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.877979:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8985f3 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.877993:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898601 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.878000:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89861d expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.878008:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898647 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.878019:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc81 expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.878026:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc88 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.878035:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.878082:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc88 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.878098:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc88 expref: 9 pid: 5779 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.878117:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510503936:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141736.879739:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc81 expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.879761:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc81 expref: 9 pid: 5782 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.879793:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504064:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141736.879869:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898647 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.879879:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898647 expref: 18 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.879889:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504192:0@lo:104: 00000100:00100000:2.0:1783141736.879936:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141736.879981:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da89861d expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.879991:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da89861d expref: 18 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.880000:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504320:0@lo:104: 00000100:00100000:2.0:1783141736.880025:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141736.880045:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898601 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.880054:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898601 expref: 18 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.880062:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504448:0@lo:104: 00010000:00010000:2.0:1783141736.880085:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8985f3 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.880093:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8985f3 expref: 18 pid: 5779 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.880109:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504576:0@lo:104: 00010000:00010000:2.0:1783141736.880137:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8985e5 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.880145:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8985e5 expref: 18 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.880153:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504704:0@lo:104: 00010000:00010000:2.0:1783141736.880196:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8985bb expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.880217:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8985bb expref: 18 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.880225:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504832:0@lo:104: 00010000:00010000:2.0:1783141736.880252:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898591 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.880260:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898591 expref: 18 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.880268:0:8307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa22680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504960:0@lo:104: 00000100:00100000:2.0:1783141736.880283:0:8307:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487f67480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141736.880380:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783141736.880400:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.880412:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.880420:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.880427:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.880435:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.880443:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510504192 00000100:00100000:0.0:1783141736.880451:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510504192 00000100:00100000:0.0:1783141736.880533:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510504320 00000100:00100000:0.0:1783141736.880542:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510504320 00000100:00100000:0.0:1783141736.880556:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510504448 00000100:00100000:0.0:1783141736.880558:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510504448 00000100:00100000:0.0:1783141736.880566:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510504576 00000100:00100000:0.0:1783141736.880568:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510504576 00000100:00100000:0.0:1783141736.880576:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510504704 00000100:00100000:0.0:1783141736.880578:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510504704 00000100:00100000:0.0:1783141736.880586:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510504832 00000100:00100000:0.0:1783141736.880588:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510504832 00000100:00100000:0.0:1783141736.880597:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510504960 00000100:00100000:0.0:1783141736.880599:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510504960 00000100:00100000:0.0:1783141736.880612:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783141736.880622:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+9:8307:x1869759510504192:12345-0@lo:104: 00010000:00010000:0.0:1783141736.880637:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.880698:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141736.880705:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+9:8307:x1869759510504192:12345-0@lo:104: Request processed in 84us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.880712:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783141736.880731:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783141736.880737:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+8:8307:x1869759510504320:12345-0@lo:104: 00010000:00010000:0.0:1783141736.880744:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.880772:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783141736.880777:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+8:8307:x1869759510504320:12345-0@lo:104: Request processed in 41us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.880782:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783141736.880812:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141736.880824:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+7:8307:x1869759510504448:12345-0@lo:104: 00010000:00010000:0.0:1783141736.880833:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.880863:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783141736.880868:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+7:8307:x1869759510504448:12345-0@lo:104: Request processed in 45us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.880873:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141736.880883:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141736.880888:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+6:8307:x1869759510504576:12345-0@lo:104: 00010000:00010000:0.0:1783141736.880894:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.880914:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783141736.880917:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+6:8307:x1869759510504576:12345-0@lo:104: Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.880922:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141736.880931:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141736.880935:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+5:8307:x1869759510504704:12345-0@lo:104: 00010000:00010000:0.0:1783141736.880941:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.880959:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783141736.880963:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+5:8307:x1869759510504704:12345-0@lo:104: Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.880967:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141736.880977:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141736.880988:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+4:8307:x1869759510504832:12345-0@lo:104: 00010000:00010000:0.0:1783141736.880995:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881017:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1783141736.881022:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+4:8307:x1869759510504832:12345-0@lo:104: Request processed in 35us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.881026:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141736.881036:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783141736.881041:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:8307:x1869759510504960:12345-0@lo:104: 00010000:00010000:0.0:1783141736.881048:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881070:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1783141736.881074:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:8307:x1869759510504960:12345-0@lo:104: Request processed in 33us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.881079:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1783141736.881104:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783141736.881110:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881117:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a7400 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141736.881122:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881131:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141736.881139:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141736.881152:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141736.881194:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881212:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141736.881234:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881242:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464814a7400/0x279ffa91da898647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89864e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881260:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783141736.881264:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881270:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030e00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141736.881273:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881280:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141736.881286:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141736.881290:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141736.881317:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881323:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141736.881334:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881340:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946480030e00/0x279ffa91da89861d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898624 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881349:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783141736.881351:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881358:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174a00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141736.881360:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881367:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141736.881372:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141736.881378:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141736.881390:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881396:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141736.881413:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881421:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2174a00/0x279ffa91da898601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898608 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881430:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783141736.881438:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881443:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141736.881447:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881453:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141736.881484:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141736.881490:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141736.881503:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881509:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141736.881515:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881521:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946480031800/0x279ffa91da8985f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985fa expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881533:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783141736.881536:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881542:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480031a00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141736.881544:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881563:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141736.881569:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141736.881574:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141736.881587:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881593:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141736.881597:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881604:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946480031a00/0x279ffa91da8985e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985ec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881613:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141736.881615:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881621:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a6800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141736.881623:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881629:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141736.881635:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141736.881646:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141736.881659:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881664:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141736.881668:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881674:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8985bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985c2 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881684:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141736.881687:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881692:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174600 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141736.881695:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881702:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141736.881707:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141736.881713:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141736.881727:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881731:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141736.881742:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881748:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2174600/0x279ffa91da898591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898598 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.881763:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141736.881765:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141736.881766:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141736.881776:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141736.881783:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141736.881799:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510505344:0@lo:103: 00000100:00100000:0.0:1783141736.881843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.881869:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510505856:0@lo:103: 00000100:00100000:0.0:1783141736.881890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.881909:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141736.881914:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510505472:0@lo:103: 00000100:00100000:0.0:1783141736.881948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.881982:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510505344 00000100:00100000:0.0:1783141736.881988:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510505344 00010000:00010000:0.0:1783141736.882013:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898601 expref: 19 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141736.882036:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510505856 00000100:00100000:0.0:1783141736.882039:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510505856 00010000:00010000:0.0:1783141736.882051:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898591 expref: 20 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141736.882067:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510505472 00000100:00100000:0.0:1783141736.882070:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510505472 00010000:00010000:0.0:1783141736.882089:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8985f3 expref: 21 pid: 5779 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141736.882103:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783141736.882111:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+21:3305:x1869759510505344:12345-0@lo:103: 00010000:00010000:0.0:1783141736.882124:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141736.882136:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898601 expref: 21 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882145:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898601 expref: 21 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882164:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141736.882194:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+21:3305:x1869759510505344:12345-0@lo:103: Request processed in 83us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.882211:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783141736.882226:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783141736.882232:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+20:3305:x1869759510505856:12345-0@lo:103: 00010000:00010000:0.0:1783141736.882241:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141736.882245:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898591 expref: 20 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882253:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898591 expref: 20 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882263:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141736.882283:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+20:3305:x1869759510505856:12345-0@lo:103: Request processed in 52us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.882290:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783141736.882309:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141736.882315:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510505472:12345-0@lo:103: 00010000:00010000:0.0:1783141736.882323:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141736.882327:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8985f3 expref: 19 pid: 5779 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882335:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8985f3 expref: 19 pid: 5779 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882345:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141736.882365:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510505472:12345-0@lo:103: Request processed in 50us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.882370:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141736.882412:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510505472:0@lo:103: 00000100:00100000:0.0:1783141736.882421:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510505344:0@lo:103: 00000100:00100000:0.0:1783141736.882428:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510505856:0@lo:103: 00000100:00100000:0.0:1783141736.882498:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510505088:0@lo:103: 00000100:00100000:0.0:1783141736.882523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.882554:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510505600:0@lo:103: 00000100:00100000:0.0:1783141736.882572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.882588:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783141736.882594:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510505216:0@lo:103: 00000100:00100000:0.0:1783141736.882612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.882625:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510505728:0@lo:103: 00000100:00100000:0.0:1783141736.882648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141736.882673:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510505088 00000100:00100000:0.0:1783141736.882677:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510505088 00010000:00010000:0.0:1783141736.882692:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898647 expref: 19 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141736.882706:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510505600 00000100:00100000:0.0:1783141736.882709:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510505600 00010000:00010000:0.0:1783141736.882724:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8985e5 expref: 20 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141736.882734:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510505216 00000100:00100000:0.0:1783141736.882736:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510505216 00010000:00010000:0.0:1783141736.882746:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89861d expref: 21 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141736.882756:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510505728 00000100:00100000:0.0:1783141736.882759:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510505728 00010000:00010000:0.0:1783141736.882769:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8985bb expref: 22 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141736.882781:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141736.882786:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+22:3307:x1869759510505088:12345-0@lo:103: 00010000:00010000:0.0:1783141736.882794:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141736.882797:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898647 expref: 22 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882806:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898647 expref: 22 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882815:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141736.882853:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+22:3307:x1869759510505088:12345-0@lo:103: Request processed in 67us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.882868:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141736.882880:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141736.882885:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+21:3307:x1869759510505600:12345-0@lo:103: 00010000:00010000:0.0:1783141736.882892:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141736.882896:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8985e5 expref: 21 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882904:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8985e5 expref: 21 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882913:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141736.882934:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+21:3307:x1869759510505600:12345-0@lo:103: Request processed in 48us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.882940:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141736.882951:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141736.882957:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+20:3307:x1869759510505216:12345-0@lo:103: 00010000:00010000:0.0:1783141736.882964:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141736.882969:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89861d expref: 20 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882977:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da89861d expref: 20 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.882985:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141736.883004:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+20:3307:x1869759510505216:12345-0@lo:103: Request processed in 48us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.883009:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783141736.883019:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783141736.883032:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493c75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510505728:12345-0@lo:103: 00010000:00010000:0.0:1783141736.883040:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141736.883044:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8985bb expref: 19 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.883051:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8985bb expref: 19 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.883059:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141736.883079:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493c75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510505728:12345-0@lo:103: Request processed in 48us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.883084:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1783141736.883259:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a7800/0x279ffa91da89864e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898647 expref: 18 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.883273:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504192:0@lo:104: 00010000:00010000:2.0:1783141736.883285:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480030800/0x279ffa91da898624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da89861d expref: 17 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.883303:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504320:0@lo:104: 00010000:00010000:2.0:1783141736.883315:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a6a00/0x279ffa91da898608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898601 expref: 16 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.883323:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504448:0@lo:104: 00010000:00010000:2.0:1783141736.883332:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480031000/0x279ffa91da8985fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8985f3 expref: 15 pid: 5779 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.883341:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504576:0@lo:104: 00010000:00010000:2.0:1783141736.883349:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a6400/0x279ffa91da8985ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8985e5 expref: 14 pid: 5782 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.883356:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504704:0@lo:104: 00010000:00010000:2.0:1783141736.883364:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0600/0x279ffa91da8985c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8985bb expref: 13 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.883371:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504832:0@lo:104: 00010000:00010000:2.0:1783141736.883381:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a7000/0x279ffa91da898598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898591 expref: 12 pid: 5780 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.883389:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa22680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504960:0@lo:104: 00000100:00100000:1.0:1783141736.883449:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510505216:0@lo:103: 00000100:00100000:1.0:1783141736.883488:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510505728:0@lo:103: 00000100:00100000:1.0:1783141736.883498:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510505088:0@lo:103: 00000100:00100000:1.0:1783141736.883504:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510505600:0@lo:103: 00000100:00100000:2.0:1783141736.888407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141736.888592:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492657152 00000100:00100000:0.0:1783141736.888604:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492657152 00010000:00010000:0.0:1783141736.888659:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc88 expref: 10 pid: 5779 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141736.888709:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:0.0:1783141736.888720:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2368:x1869759492657152:12345-192.168.203.27@tcp:103: 00010000:00010000:0.0:1783141736.888739:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141736.888746:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc88 expref: 10 pid: 5779 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.888761:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc88 expref: 10 pid: 5779 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.888787:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141736.888857:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2368:x1869759492657152:12345-192.168.203.27@tcp:103: Request processed in 138us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141736.888887:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00010000:00010000:1.0:1783141736.889636:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2175600/0x279ffa91da898663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc88 expref: 9 pid: 5779 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141736.889665:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510503936:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141736.889679:0:8307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1869759510504064:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141736.889728:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141736.897911:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141736.897994:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492657280 00000100:00100000:2.0:1783141736.898007:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492657280 00010000:00010000:2.0:1783141736.898055:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc81 expref: 9 pid: 5782 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141736.898133:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:2.0:1783141736.898145:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:2369:x1869759492657280:12345-192.168.203.27@tcp:103: 00010000:00010000:2.0:1783141736.898177:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141736.898183:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc81 expref: 9 pid: 5782 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898197:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc81 expref: 9 pid: 5782 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898236:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2175000/0x279ffa91da89865c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fc81 expref: 9 pid: 5782 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898257:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898267:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898287:0:6600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898295:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898302:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898308:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898324:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141736.898329:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898338:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898360:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141736.898372:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141736.898436:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:2369:x1869759492657280:12345-192.168.203.27@tcp:103: Request processed in 292us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141736.898445:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00010000:00010000:0.0:1783141736.899644:0:8307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.899662:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141736.899670:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0800/0x279ffa91da89869b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141737.179403:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141737.500950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141737.501115:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492657408 00000100:00100000:1.0:1783141737.501128:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492657408 00000100:00100000:1.0:1783141737.501206:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 130 00000100:00100000:1.0:1783141737.501218:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:5580:x1869759492657408:12345-192.168.203.27@tcp:101: 00010000:00010000:1.0:1783141737.501241:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141737.501268:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a6400/0x279ffa91da8986a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fcea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141737.501304:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a6400/0x279ffa91da8986a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcea expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141737.501317:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a6400/0x279ffa91da8986a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcea expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141737.501328:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6400, rc 0) 00000100:00100000:1.0:1783141737.501402:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5580:x1869759492657408:12345-192.168.203.27@tcp:101: Request processed in 186us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141737.501411:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 130 00000100:00100000:0.0:1783141737.509397:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141737.510248:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492657536 00000100:00100000:3.0:1783141737.510265:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492657536 00000100:00100000:3.0:1783141737.510349:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:3.0:1783141737.510362:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5580:x1869759492657536:12345-192.168.203.27@tcp:501: 00000100:00100000:3.0:1783141737.512485:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5580:x1869759492657536:12345-192.168.203.27@tcp:501: Request processed in 2099us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141737.512504:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:1.0:1783141737.526422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141737.526503:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492657664 00000100:00100000:1.0:1783141737.526515:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492657664 00000100:00100000:1.0:1783141737.526593:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 132 00000100:00100000:1.0:1783141737.526604:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5580:x1869759492657664:12345-192.168.203.27@tcp:503: 00000100:00100000:1.0:1783141737.526901:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5580:x1869759492657664:12345-192.168.203.27@tcp:503: Request processed in 296us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141737.526912:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 132 00000100:00100000:2.0:1783141737.536165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141737.536275:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492657792 00000100:00100000:0.0:1783141737.536289:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492657792 00000100:00100000:0.0:1783141737.536353:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00100000:0.0:1783141737.536366:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:6045:x1869759492657792:12345-192.168.203.27@tcp:502: 00000100:00100000:0.0:1783141737.536737:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:6045:x1869759492657792:12345-192.168.203.27@tcp:502: Request processed in 371us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141737.536748:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00100000:1.0:1783141737.543391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141737.543502:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492657920 00000100:00100000:3.0:1783141737.543523:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492657920 00000100:00100000:3.0:1783141737.543582:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:3.0:1783141737.543594:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:6045:x1869759492657920:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783141737.544148:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:6045:x1869759492657920:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 552us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141737.544159:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:2.0:1783141737.547814:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141737.549347:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492658048 00000100:00100000:1.0:1783141737.549364:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492658048 00000100:00100000:1.0:1783141737.549517:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 135 00000100:00100000:1.0:1783141737.549530:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5580:x1869759492658048:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141737.549552:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141737.549576:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a7400/0x279ffa91da8986a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fcf1 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141737.549611:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a7400/0x279ffa91da8986a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf1 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141737.549623:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a7400/0x279ffa91da8986a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf1 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141737.549634:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a7400, rc 0) 00000100:00100000:1.0:1783141737.549775:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5580:x1869759492658048:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 246us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141737.549783:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 135 00000100:00100000:1.0:1783141737.564783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141737.564917:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492658176 00000100:00100000:3.0:1783141737.564932:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492658176 00000100:00100000:3.0:1783141737.565815:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 136 00000100:00100000:3.0:1783141737.565831:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5580:x1869759492658176:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141737.566163:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5580:x1869759492658176:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 334us (1395us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783141737.566173:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 136 00010000:00010000:0.0:1783141738.203297:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783141738.458615:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783141738.458626:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff946381363000 from 39 10000000:01000000:1.0:1783141738.458633:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783141738.458705:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.458719:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.458733:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141738.458763:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510505984:0@lo:101: 00000100:00100000:1.0:1783141738.458954:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.459029:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281300 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.459158:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510505984 00000100:00100000:2.0:1783141738.459168:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510505984 00000100:00100000:2.0:1783141738.459244:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783141738.459255:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+12:5784:x1869759510505984:12345-0@lo:101: 00010000:00010000:2.0:1783141738.459274:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141738.459289:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a0000/0x279ffa91da8986b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8986b0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.459329:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0000/0x279ffa91da8986b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8986b0 expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.459342:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a0000/0x279ffa91da8986b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8986b0 expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.459358:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0000, rc 0) 00000100:00100000:2.0:1783141738.459420:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510505984:12345-0@lo:101: Request processed in 166us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.459438:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783141738.459752:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510505984:0@lo:101: 00010000:00010000:1.0:1783141738.459772:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.459782:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141738.459945:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506112:0@lo:501: 00000100:00100000:1.0:1783141738.459982:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.460020:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281300 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.460074:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510506112 00000100:00100000:2.0:1783141738.460079:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510506112 00000100:00100000:2.0:1783141738.460116:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783141738.460124:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510506112:12345-0@lo:501: 00000100:00100000:2.0:1783141738.460764:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510506112:12345-0@lo:501: Request processed in 637us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.460774:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783141738.463389:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506112:0@lo:501: 00000100:00100000:1.0:1783141738.463657:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506240:0@lo:503: 00000100:00100000:1.0:1783141738.463762:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.463827:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281300 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.463977:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510506240 00000100:00100000:2.0:1783141738.463987:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510506240 00000100:00100000:2.0:1783141738.464126:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783141738.464139:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510506240:12345-0@lo:503: 00000100:00100000:2.0:1783141738.464440:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510506240:12345-0@lo:503: Request processed in 303us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.464450:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783141738.464576:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506240:0@lo:503: 00000100:00100000:1.0:1783141738.464840:0:8331:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8331:1869759510506368:0@lo:502: 00000100:00100000:1.0:1783141738.464913:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.472534:0:8331:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141738.476314:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510506368 00000100:00100000:3.0:1783141738.476338:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510506368 00000100:00100000:3.0:1783141738.476427:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783141738.476440:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+13:8331:x1869759510506368:12345-0@lo:502: 00000100:00100000:3.0:1783141738.476853:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+13:8331:x1869759510506368:12345-0@lo:502: Request processed in 413us (11937us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141738.476863:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783141738.477178:0:8331:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8331:1869759510506368:0@lo:502: 00000100:00100000:1.0:1783141738.477272:0:8331:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8331:1869759510506496:0@lo:502: 00000100:00100000:1.0:1783141738.477340:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.477377:0:8331:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488332e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.483393:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510506496 00000100:00100000:2.0:1783141738.483414:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510506496 00000100:00100000:1.0:1783141738.483585:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783141738.483603:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:8331:x1869759510506496:12345-0@lo:502: 00000100:00100000:1.0:1783141738.484245:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:8331:x1869759510506496:12345-0@lo:502: Request processed in 645us (6903us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141738.484255:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783141738.484563:0:8331:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8331:1869759510506496:0@lo:502: 00000040:00080000:1.0:1783141738.484683:0:8331:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783141738.485035:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783141738.485060:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141738.485073:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.485104:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141738.485238:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783141738.485242:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1783141738.485246:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783141738.485407:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.485417:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.485429:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141738.485455:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506624:0@lo:101: 00000100:00100000:1.0:1783141738.485603:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.485693:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfff2900 going to sleep for 11 seconds 00000100:00100000:0.0:1783141738.485743:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510506624 00000100:00100000:0.0:1783141738.485752:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510506624 00000100:00100000:1.0:1783141738.485994:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783141738.486016:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+13:5784:x1869759510506624:12345-0@lo:101: 00010000:00010000:1.0:1783141738.486033:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141738.486049:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a6a00/0x279ffa91da8986c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8986be expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.486079:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a6a00/0x279ffa91da8986c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8986be expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.486090:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a6a00/0x279ffa91da8986c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8986be expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.486101:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6a00, rc 0) 00000100:00100000:1.0:1783141738.486279:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510506624:12345-0@lo:101: Request processed in 264us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141738.486287:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783141738.486532:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506624:0@lo:101: 00010000:00010000:0.0:1783141738.486552:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.486562:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141738.486697:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506752:0@lo:501: 00000100:00100000:1.0:1783141738.486732:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.486864:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfff2000 going to sleep for 11 seconds 00000100:00100000:0.0:1783141738.486970:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510506752 00000100:00100000:0.0:1783141738.486977:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510506752 00000100:00100000:1.0:1783141738.487059:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783141738.487068:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510506752:12345-0@lo:501: 00000100:00100000:1.0:1783141738.489008:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510506752:12345-0@lo:501: Request processed in 1927us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141738.489024:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783141738.489143:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506752:0@lo:501: 00000100:00100000:0.0:1783141738.495036:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506880:0@lo:503: 00000100:00100000:0.0:1783141738.495166:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141738.495245:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464877dc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141738.495762:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510506880 00000100:00100000:3.0:1783141738.495774:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510506880 00000100:00100000:3.0:1783141738.495858:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783141738.495872:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510506880:12345-0@lo:503: 00000100:00100000:3.0:1783141738.496161:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510506880:12345-0@lo:503: Request processed in 292us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141738.496183:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783141738.496252:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510506880:0@lo:503: 00000100:00100000:3.0:1783141738.498181:0:8332:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8332:1869759510507008:0@lo:502: 00000100:00100000:3.0:1783141738.498315:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141738.498373:0:8332:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899300 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.498386:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510507008 00000100:00100000:2.0:1783141738.498397:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510507008 00000100:00100000:2.0:1783141738.498479:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783141738.498490:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:8332:x1869759510507008:12345-0@lo:502: 00000100:00100000:2.0:1783141738.498763:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:8332:x1869759510507008:12345-0@lo:502: Request processed in 274us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.498782:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783141738.499539:0:8332:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8332:1869759510507008:0@lo:502: 00000020:01000000:3.0:1783141738.499587:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141738.499600:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141738.499603:0:8332:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783141738.499610:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783141738.499647:0:8332:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8332:1869759510507136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141738.499705:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141738.499762:0:8332:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899300 going to sleep for 11 seconds 00000100:00100000:0.0:1783141738.499875:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510507136 00000100:00100000:0.0:1783141738.499882:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510507136 00000100:00100000:0.0:1783141738.499938:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783141738.499948:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:8332:x1869759510507136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141738.500180:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+14:8332:x1869759510507136:12345-0@lo:502:llog_process_th.0 Request processed in 232us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141738.500207:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783141738.500396:0:8332:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8332:1869759510507136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783141738.500435:0:8332:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141738.500443:0:8332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141738.500445:0:8332:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783141738.500450:0:8332:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1783141738.501003:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1783141738.501029:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783141738.501044:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.501056:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141738.501067:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783141738.501070:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff94649d28d000 from 39 10000000:01000000:0.0:1783141738.501074:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783141738.501111:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.501120:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.501130:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141738.501884:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510507264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141738.501984:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141738.502044:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464877dc180 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.502234:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510507264 00000100:00100000:2.0:1783141738.502244:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510507264 00000100:00100000:2.0:1783141738.502296:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783141738.502318:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+14:5784:x1869759510507264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141738.502339:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141738.502360:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a0c00/0x279ffa91da8986d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8986cc expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.502394:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0c00/0x279ffa91da8986d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8986cc expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.502405:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a0c00/0x279ffa91da8986d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8986cc expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.502415:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0c00, rc 0) 00000100:00100000:2.0:1783141738.502499:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510507264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.502506:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783141738.502640:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510507264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141738.502658:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.502688:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141738.502758:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510507392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141738.502882:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141738.502981:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464877dc180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141738.503032:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510507392 00000100:00100000:3.0:1783141738.503038:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510507392 00000100:00100000:3.0:1783141738.503077:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783141738.503085:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510507392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.503632:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510507392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 543us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141738.503641:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783141738.503758:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510507392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141738.503878:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510507520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141738.504426:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141738.504495:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464877dc180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141738.504952:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510507520 00000100:00100000:3.0:1783141738.504962:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510507520 00000100:00100000:3.0:1783141738.505018:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783141738.505029:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510507520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.505614:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510507520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 584us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141738.505625:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783141738.506386:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510507520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.507090:0:8333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8333:1869759510507648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141738.507203:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141738.507262:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510507648 00000100:00100000:3.0:1783141738.507263:0:8333:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:0.0:1783141738.507347:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510507648 00000100:00100000:0.0:1783141738.507413:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783141738.507424:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+15:8333:x1869759510507648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141738.507756:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+15:8333:x1869759510507648:12345-0@lo:502:llog_process_th.0 Request processed in 332us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141738.507766:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783141738.509034:0:8333:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8333:1869759510507648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141738.509145:0:8333:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8333:1869759510507776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141738.509247:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141738.509300:0:8333:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.509433:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510507776 00000100:00100000:2.0:1783141738.509441:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510507776 00000100:00100000:2.0:1783141738.509512:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783141738.509525:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+15:8333:x1869759510507776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141738.509833:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+15:8333:x1869759510507776:12345-0@lo:502:llog_process_th.0 Request processed in 310us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.509843:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783141738.510065:0:8333:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8333:1869759510507776:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783141738.510097:0:8333:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1783141738.510709:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1783141738.510736:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783141738.510749:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141738.510763:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141738.510774:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783141738.510778:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1783141738.510781:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783141738.510822:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141738.510831:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141738.510842:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141738.510893:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510507904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.510948:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141738.511000:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:0.0:1783141738.511227:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510507904 00000100:00100000:0.0:1783141738.511235:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510507904 00000100:00100000:0.0:1783141738.511357:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783141738.511370:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+15:5784:x1869759510507904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141738.511387:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141738.511404:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94649d0d6200/0x279ffa91da8986e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8986da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.511444:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d6200/0x279ffa91da8986e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8986da expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.511455:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94649d0d6200/0x279ffa91da8986e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8986da expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.511485:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6200, rc 0) 00000100:00100000:0.0:1783141738.511539:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510507904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141738.511546:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783141738.512995:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510507904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141738.513030:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141738.513045:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141738.513145:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.513223:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141738.513275:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.513339:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510508032 00000100:00100000:2.0:1783141738.513346:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510508032 00000100:00100000:2.0:1783141738.513397:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783141738.513408:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510508032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141738.513809:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510508032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.513817:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783141738.513883:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141738.513946:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141738.513998:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.514043:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfff2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141738.514126:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510508160 00000100:00100000:3.0:1783141738.514132:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510508160 00000100:00100000:3.0:1783141738.514171:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783141738.514180:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510508160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.514373:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510508160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141738.514380:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783141738.514420:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141738.519890:0:8334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8334:1869759510508288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141738.520007:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141738.520063:0:8334:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487f67780 going to sleep for 11 seconds 00000100:00100000:3.0:1783141738.520115:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510508288 00000100:00100000:3.0:1783141738.520124:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510508288 00000100:00100000:3.0:1783141738.520179:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783141738.520199:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:8334:x1869759510508288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141738.520533:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:8334:x1869759510508288:12345-0@lo:502:llog_process_th.0 Request processed in 343us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141738.520543:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783141738.520655:0:8334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8334:1869759510508288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783141738.520688:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141738.520699:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141738.520701:0:8334:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783141738.520706:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783141738.520728:0:8334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8334:1869759510508416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141738.520759:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141738.520790:0:8334:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f840 going to sleep for 11 seconds 00000100:00100000:3.0:1783141738.521073:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510508416 00000100:00100000:3.0:1783141738.521079:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510508416 00000100:00100000:3.0:1783141738.521113:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783141738.521120:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:8334:x1869759510508416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141738.521292:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:8334:x1869759510508416:12345-0@lo:502:llog_process_th.0 Request processed in 171us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141738.521307:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783141738.521619:0:8334:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8334:1869759510508416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783141738.521649:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141738.521656:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141738.521658:0:8334:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783141738.521663:0:8334:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1783141738.521856:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1783141738.521879:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783141738.521893:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141738.521906:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141738.521919:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783141738.521922:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff946489ce7800 from 39 10000000:01000000:3.0:1783141738.521925:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783141738.521960:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141738.521968:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141738.521978:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141738.522006:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.522048:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141738.522092:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141738.522136:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510508544 00000100:00100000:1.0:1783141738.522145:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510508544 00000100:00100000:1.0:1783141738.522200:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783141738.522210:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510508544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141738.522224:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141738.522240:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464814a6e00/0x279ffa91da8986ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8986e8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.522268:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464814a6e00/0x279ffa91da8986ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8986e8 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.522279:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464814a6e00/0x279ffa91da8986ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8986e8 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.522289:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6e00, rc 0) 00000100:00100000:1.0:1783141738.522336:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510508544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141738.522343:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783141738.523577:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141738.523607:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141738.523621:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141738.523705:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.523761:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141738.523806:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141738.523877:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510508672 00000100:00100000:1.0:1783141738.523884:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510508672 00000100:00100000:1.0:1783141738.523934:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783141738.523944:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510508672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141738.524324:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510508672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 381us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141738.524333:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783141738.524524:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.524564:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.524609:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141738.524636:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141738.524679:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510508800 00000100:00100000:1.0:1783141738.524685:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510508800 00000100:00100000:1.0:1783141738.524723:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783141738.524738:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510508800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141738.524932:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510508800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141738.524940:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783141738.524987:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510508800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141738.525879:0:8335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8335:1869759510508928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141738.525940:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141738.525968:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510508928 00000100:00100000:2.0:1783141738.525974:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510508928 00000100:00100000:2.0:1783141738.526006:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783141738.526014:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:8335:x1869759510508928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141738.526256:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:8335:x1869759510508928:12345-0@lo:502:llog_process_th.0 Request processed in 241us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.526264:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783141738.526390:0:8335:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.526409:0:8335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8335:1869759510508928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141738.526588:0:8335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8335:1869759510509056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141738.526624:0:8335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141738.526648:0:8335:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141738.528153:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510509056 00000100:00100000:1.0:1783141738.528169:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510509056 00000100:00100000:1.0:1783141738.528241:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783141738.528253:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:8335:x1869759510509056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141738.528630:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:8335:x1869759510509056:12345-0@lo:502:llog_process_th.0 Request processed in 377us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141738.528641:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783141738.529918:0:8335:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8335:1869759510509056:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783141738.529978:0:8335:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783141738.530406:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783141738.530445:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783141738.530483:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.530497:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141738.530510:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783141738.530513:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1783141738.530517:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783141738.530566:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.530575:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.530586:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141738.530634:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141738.530715:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141738.530768:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946488332e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.531977:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510509184 00000100:00100000:2.0:1783141738.531995:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510509184 00000100:00100000:2.0:1783141738.532072:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783141738.532084:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510509184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141738.532106:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141738.532129:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a1000/0x279ffa91da8986fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8986f6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.532187:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a1000/0x279ffa91da8986fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8986f6 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.532209:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a1000/0x279ffa91da8986fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8986f6 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.532220:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1000, rc 0) 00000100:00100000:2.0:1783141738.532325:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510509184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.532335:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783141738.532509:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141738.532534:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.532546:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141738.532633:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141738.532675:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.532714:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfff2000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141738.534398:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510509312 00000100:00100000:3.0:1783141738.534415:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510509312 00000100:00100000:3.0:1783141738.534488:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783141738.534498:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510509312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.534891:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510509312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 393us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141738.534900:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783141738.534975:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.535041:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141738.535103:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141738.535141:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464868993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141738.535348:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510509440 00000100:00100000:0.0:1783141738.535354:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510509440 00000100:00100000:0.0:1783141738.535401:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783141738.535409:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510509440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141738.535651:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510509440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141738.535660:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783141738.535982:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141738.536711:0:8337:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8337:1869759510509568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141738.536790:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141738.536837:0:8337:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141738.536885:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510509568 00000100:00100000:0.0:1783141738.536893:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510509568 00000100:00100000:0.0:1783141738.536939:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783141738.536949:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:8337:x1869759510509568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141738.537237:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:8337:x1869759510509568:12345-0@lo:502:llog_process_th.0 Request processed in 287us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141738.537245:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783141738.537340:0:8337:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8337:1869759510509568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783141738.537372:0:8337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141738.537384:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141738.537387:0:8337:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783141738.537394:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783141738.537421:0:8337:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8337:1869759510509696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141738.537505:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141738.537537:0:8337:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141738.537740:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510509696 00000100:00100000:0.0:1783141738.537745:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510509696 00000100:00100000:0.0:1783141738.537785:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783141738.537793:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:8337:x1869759510509696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141738.537976:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:8337:x1869759510509696:12345-0@lo:502:llog_process_th.0 Request processed in 183us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141738.537983:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783141738.538104:0:8337:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8337:1869759510509696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783141738.538130:0:8337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141738.538135:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141738.538137:0:8337:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783141738.538141:0:8337:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1783141738.538397:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1783141738.538594:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783141738.538609:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.538621:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141738.538632:0:5784:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783141738.538636:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff946482f299c0 from 1 10000000:01000000:0.0:1783141738.538640:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783141738.538677:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.538685:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141738.538696:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141738.538717:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141738.538765:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141738.538814:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497281540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.538861:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510509824 00000100:00100000:2.0:1783141738.538869:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510509824 00000100:00100000:2.0:1783141738.538913:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783141738.538921:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510509824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141738.538935:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141738.538950:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a0400/0x279ffa91da89870b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898704 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.538976:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0400/0x279ffa91da89870b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898704 expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.538987:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a0400/0x279ffa91da89870b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898704 expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.538997:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0400, rc 0) 00000100:00100000:2.0:1783141738.539044:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510509824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.539050:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783141738.539129:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141738.539146:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89870b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141738.539155:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da89870b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141738.539228:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141738.539258:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141738.539282:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfff2900 going to sleep for 11 seconds 00000100:00100000:2.0:1783141738.539392:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510509952 00000100:00100000:2.0:1783141738.539397:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510509952 00000100:00100000:2.0:1783141738.539578:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783141738.539588:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510509952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141738.539879:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510509952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (617us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783141738.539886:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783141738.539923:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510509952:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783141738.539948:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783141738.539955:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89870b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141738.539969:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89870b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141738.716178:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141738.716232:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141738.716274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141738.716304:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141738.716397:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492658432 00000100:00100000:0.0:1783141738.716410:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492658432 00000100:00080000:1.0:1783141738.716599:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141738.717265:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:0.0:1783141738.717285:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492658432:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141738.717324:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492658304 00000100:00100000:2.0:1783141738.717332:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492658304 00000100:00100000:2.0:1783141738.717382:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 169 00000100:00100000:2.0:1783141738.717392:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2367:x1869759492658304:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141738.717399:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492658432:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 120us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141738.717410:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1783141738.717433:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2367:x1869759492658304:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 42us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.717443:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 169 00000100:00100000:2.0:1783141738.717524:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492658688 00000100:00100000:2.0:1783141738.717529:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492658688 00000100:00100000:2.0:1783141738.717568:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492658560 00000100:00100000:2.0:1783141738.717572:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492658560 00000100:00100000:2.0:1783141738.717595:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:2.0:1783141738.717604:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492658688:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141738.717638:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492658688:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 35us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.717644:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:2.0:1783141738.717659:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:2.0:1783141738.717666:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492658560:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141738.717692:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492658560:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141738.717698:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00080000:2.0:1783141738.717725:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141738.717729:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1783141739.168290:0:8367:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8195b490 20000000:00000080:0.0:1783141739.168307:0:8367:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff946496a1b400 uarg=0000000000000000 20000000:01000000:0.0:1783141739.168341:0:8367:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783141739.168347:0:8367:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783141739.168352:0:8367:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783141739.174843:0:8368:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1783141739.174998:0:8367:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1783141739.183444:0:8367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1783141739.184214:0:8367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1783141739.184283:0:8367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1783141739.184302:0:8367:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783141739.184322:0:8367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.184349:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2174200/0x279ffa91da8984db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8984d4 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.184357:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898552 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.184363:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8985ad expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.184373:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb9 expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.184381:0:8367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.184419:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb9 expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.184449:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb9 expref: 9 pid: 5782 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141739.185110:0:8367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1869759510510080:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141739.185235:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8985ad expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.185247:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8985ad expref: 18 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141739.185258:0:8367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1869759510510208:0@lo:104: 00000100:00100000:3.0:1783141739.186404:0:8367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141739.186558:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898552 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.186572:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898552 expref: 18 pid: 5779 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141739.186584:0:8367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1869759510510336:0@lo:104: 00000100:00100000:3.0:1783141739.186619:0:8367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141739.186653:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2174200/0x279ffa91da8984db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8984d4 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141739.186661:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464c2174200/0x279ffa91da8984db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8984d4 expref: 18 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141739.186669:0:8367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1869759510510464:0@lo:104: 00000100:00100000:3.0:1783141739.186686:0:8367:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649683fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141739.186805:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783141739.186831:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141739.186843:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510510208 00000100:00100000:0.0:1783141739.186850:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510510208 00000100:00100000:0.0:1783141739.186884:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510510336 00000100:00100000:0.0:1783141739.186887:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510510336 00000100:00100000:0.0:1783141739.186897:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510510464 00000100:00100000:0.0:1783141739.186899:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510510464 00000100:00100000:0.0:1783141739.186911:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783141739.186918:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+5:8367:x1869759510510208:12345-0@lo:104: 00010000:00010000:0.0:1783141739.186930:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141739.186982:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141739.186988:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+5:8367:x1869759510510208:12345-0@lo:104: Request processed in 71us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141739.186994:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783141739.187008:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141739.187013:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496a18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+4:8367:x1869759510510336:12345-0@lo:104: 00010000:00010000:0.0:1783141739.187020:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141739.187634:0:8367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1869759510510208:0@lo:104: 00000100:00100000:3.0:1783141739.187644:0:8367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1869759510510336:0@lo:104: 00010000:00010000:0.0:1783141739.188678:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783141739.188691:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496a18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+4:8367:x1869759510510336:12345-0@lo:104: Request processed in 1675us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141739.188716:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141739.188772:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141739.188783:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:8367:x1869759510510464:12345-0@lo:104: 00010000:00010000:0.0:1783141739.188799:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141739.189605:0:8367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1869759510510464:0@lo:104: 00010000:00010000:2.0:1783141739.192027:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783141739.192041:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192061:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030000 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141739.192065:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192075:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141739.192083:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141739.192090:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141739.192150:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192157:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141739.192197:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192204:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946480030000/0x279ffa91da8985ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8985b4 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192221:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783141739.192224:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192247:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a7a00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141739.192251:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192258:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141739.192264:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141739.192268:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141739.192281:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192286:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141739.192302:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192310:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464814a7a00/0x279ffa91da898552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898559 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192320:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141739.192323:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.192329:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2043600 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141739.194629:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.194668:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141739.194675:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141739.194681:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141739.194726:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.194732:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141739.194746:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.194754:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2043600/0x279ffa91da8984d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8984db expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.194777:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141739.194779:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141739.194782:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141739.194821:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510510592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141739.194895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141739.194967:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510510720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141739.194990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141739.195009:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141739.195014:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510510848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141739.195034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141739.195076:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510510592 00000100:00100000:2.0:1783141739.195089:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510510592 00010000:00010000:2.0:1783141739.195120:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8985ad expref: 19 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141739.195145:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510510720 00000100:00100000:2.0:1783141739.195148:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510510720 00010000:00010000:2.0:1783141739.195159:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898552 expref: 20 pid: 5779 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141739.195174:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510510848 00000100:00100000:2.0:1783141739.195176:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510510848 00010000:00010000:2.0:1783141739.195198:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2174200/0x279ffa91da8984db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8984d4 expref: 21 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141739.195213:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783141739.195220:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:872ec41a-f648-467b-b036-39669ac398c4+21:3306:x1869759510510592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141739.195231:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141739.195236:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8985ad expref: 21 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.195246:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8985ad expref: 21 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.195259:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a6000/0x279ffa91da8985b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8985ad expref: 21 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.195273:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141739.195301:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:872ec41a-f648-467b-b036-39669ac398c4+20:3306:x1869759510510592:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141739.195308:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783141739.195322:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783141739.195334:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510510720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141739.195341:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141739.195346:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898552 expref: 19 pid: 5779 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.195354:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898552 expref: 19 pid: 5779 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.195363:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480030400/0x279ffa91da898559 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898552 expref: 19 pid: 5779 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.195372:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141739.195396:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:872ec41a-f648-467b-b036-39669ac398c4+18:3307:x1869759510510720:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141739.195401:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783141739.195412:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783141739.195417:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:872ec41a-f648-467b-b036-39669ac398c4+17:3307:x1869759510510848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141739.195423:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141739.195428:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2174200/0x279ffa91da8984db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8984d4 expref: 17 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.195435:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2174200/0x279ffa91da8984db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8984d4 expref: 17 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.195443:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2174200/0x279ffa91da8984db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8984d4 expref: 17 pid: 5780 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.195451:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141739.195506:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:872ec41a-f648-467b-b036-39669ac398c4+16:3307:x1869759510510848:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141739.195519:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783141739.195568:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510510848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141739.195578:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510510720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141739.195602:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510510592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141739.195770:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141739.195994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141739.196027:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492658816 00000100:00100000:2.0:1783141739.196032:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492658816 00010000:00010000:2.0:1783141739.196108:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb9 expref: 10 pid: 5782 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141739.196145:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:2.0:1783141739.196151:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2369:x1869759492658816:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141739.196161:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141739.196165:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb9 expref: 10 pid: 5782 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196176:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb9 expref: 10 pid: 5782 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196201:0:7493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196210:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196227:0:7493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196245:0:7493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196251:0:7493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196256:0:7493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196262:0:7493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141739.196266:0:7493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196273:0:7493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196282:0:7493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.196292:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141739.196346:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2369:x1869759492658816:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 194us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141739.196353:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00010000:00010000:0.0:1783141739.196493:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1783141739.196501:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:8367:x1869759510510464:12345-0@lo:104: Request processed in 7721us (9668us total) trans 0 rc 0/0 00010000:00010000:1.0:1783141739.196508:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2175400/0x279ffa91da898671 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb9 expref: 9 pid: 5782 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141739.196508:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783141739.196518:0:8367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1869759510510080:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141739.196542:0:8367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141739.196550:0:8367:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141739.196554:0:8367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141739.196560:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2175600/0x279ffa91da898712 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141739.197744:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141739.236153:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141739.547587:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510511232:0@lo:400:kworker.0 00000100:00100000:1.0:1783141739.547663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141739.547755:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141739.547763:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510511360:0@lo:400:kworker.0 00000100:00100000:1.0:1783141739.547791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141739.548384:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510511232 00000100:00100000:0.0:1783141739.548394:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510511232 00000100:00100000:0.0:1783141739.548481:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783141739.548491:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510511232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141739.548551:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510511232:12345-0@lo:400:kworker.0 Request processed in 62us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141739.548558:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1783141739.548623:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783141739.548657:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5ce00 x1869759510511232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141739.548671:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510511232:0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.552607:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510511104:0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.552687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141739.552729:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783141739.552737:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510510976:0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.552760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141739.552778:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510511488:0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.552800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141739.552843:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510511360 00000100:00100000:3.0:1783141739.552851:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510511360 00000100:00100000:3.0:1783141739.552899:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510511104 00000100:00100000:3.0:1783141739.552902:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510511104 00000100:00100000:3.0:1783141739.552917:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510510976 00000100:00100000:3.0:1783141739.552920:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510510976 00000100:00100000:3.0:1783141739.552934:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783141739.552943:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510511360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.553010:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510511360:12345-0@lo:400:kworker.0 Request processed in 68us (5217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141739.553018:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783141739.553032:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783141739.553050:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510511104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.553093:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510511104:12345-0@lo:400:kworker.0 Request processed in 45us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141739.553099:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783141739.553131:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783141739.553137:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510510976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.553165:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510510976:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141739.553171:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783141739.553199:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510511488 00000100:00100000:3.0:1783141739.553202:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510511488 00000100:00100000:3.0:1783141739.553229:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783141739.553241:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510511488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.553272:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510511488:12345-0@lo:400:kworker.0 Request processed in 33us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141739.553279:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1783141739.553315:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141739.553319:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141739.553355:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510510976:0@lo:400:kworker.0 00010000:00080000:3.0:1783141739.553369:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5e300 x1869759510511488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141739.553379:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510511488:0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.553388:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510511104:0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.553426:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510511360:0@lo:400:kworker.0 00000100:00100000:3.0:1783141739.556500:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510511616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141739.556563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141739.562138:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510511616 00000100:00100000:1.0:1783141739.562152:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510511616 00000100:00100000:1.0:1783141739.562233:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783141739.562245:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510511616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141739.562284:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141739.562370:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510511616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (5805us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141739.562377:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783141739.562597:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5f480 x1869759510511616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141739.562639:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510511616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141740.058814:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783141740.058839:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510511744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141740.058910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141740.059065:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510511744 00000100:00100000:0.0:1783141740.059073:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510511744 00000100:00100000:0.0:1783141740.059123:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141740.059132:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510511744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141740.059166:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141740.059548:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510511744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 415us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141740.059556:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1783141740.061271:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5c380 x1869759510511744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141740.061395:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510511744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141740.252338:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141740.380093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141740.380160:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492658944 00000100:00100000:0.0:1783141740.380170:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492658944 00000100:00100000:0.0:1783141740.380238:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 170 00000100:00100000:0.0:1783141740.380257:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:5580:x1869759492658944:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141740.380276:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141740.380297:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fcf8 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.380324:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf8 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.380335:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf8 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141740.380344:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6e00, rc 0) 00000100:00100000:0.0:1783141740.380397:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5580:x1869759492658944:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 149us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141740.380403:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 170 00000100:00100000:1.0:1783141740.398948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141740.399031:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492659072 00000100:00100000:2.0:1783141740.399040:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492659072 00000100:00100000:2.0:1783141740.399145:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 171 00000100:00100000:2.0:1783141740.399156:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5580:x1869759492659072:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141740.399636:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5580:x1869759492659072:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 481us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.399645:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 171 00000100:00100000:3.0:1783141740.403526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141740.403609:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492659200 00000100:00100000:2.0:1783141740.403619:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492659200 00000100:00100000:2.0:1783141740.403670:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 172 00000100:00100000:2.0:1783141740.403679:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5580:x1869759492659200:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141740.403889:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:5580:x1869759492659200:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 210us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141740.403897:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 172 00000100:00100000:2.0:1783141740.417890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141740.418189:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492659328 00000100:00100000:3.0:1783141740.418199:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492659328 00000100:00100000:3.0:1783141740.418252:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 173 00000100:00100000:3.0:1783141740.418263:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:6102:x1869759492659328:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783141740.418527:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:6102:x1869759492659328:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 265us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141740.418536:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 173 00000100:00100000:3.0:1783141740.424399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141740.424504:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492659456 00000100:00100000:1.0:1783141740.424514:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492659456 00000100:00100000:1.0:1783141740.424564:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 174 00000100:00100000:1.0:1783141740.424574:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:6102:x1869759492659456:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783141740.424810:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:6102:x1869759492659456:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 236us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141740.424817:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 174 10000000:01000000:1.0:1783141741.146579:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141741.146586:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946381363000 from 4 10000000:01000000:1.0:1783141741.146592:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141741.146643:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.146667:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.146679:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141741.146706:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510511872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.146789:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.146857:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783141741.147039:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510511872 00000100:00100000:2.0:1783141741.147047:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510511872 00000100:00100000:2.0:1783141741.147108:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783141741.147116:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510511872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141741.147130:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141741.147143:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898720 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.147164:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898720 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.147193:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898720 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141741.147202:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1c00, rc 0) 00000100:00100000:2.0:1783141741.147262:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510511872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.147270:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783141741.147405:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510511872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141741.147420:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141741.147428:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141741.147535:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141741.147564:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141741.147596:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a34d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141741.147725:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510512000 00000100:00100000:2.0:1783141741.147730:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510512000 00000100:00100000:2.0:1783141741.147761:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783141741.147768:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510512000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141741.148046:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510512000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.148053:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783141741.148373:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141741.148409:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141741.148449:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141741.148512:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141741.148561:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510512128 00000100:00100000:3.0:1783141741.148567:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510512128 00000100:00100000:3.0:1783141741.148591:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783141741.148599:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510512128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141741.148766:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510512128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141741.148773:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783141741.148885:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141741.149235:0:8447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8447:1869759510512256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141741.149275:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141741.149293:0:8447:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141741.149386:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510512256 00000100:00100000:3.0:1783141741.149391:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510512256 00000100:00100000:3.0:1783141741.149409:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783141741.149416:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:8447:x1869759510512256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141741.149577:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:8447:x1869759510512256:12345-0@lo:502:llog_process_th.0 Request processed in 161us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141741.149584:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1783141741.149744:0:8447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8447:1869759510512256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141741.149765:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141741.149774:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141741.149776:0:8447:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783141741.149781:0:8447:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff946381363000 00000020:00000080:0.0:1783141741.149784:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783141741.149855:0:8447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8447:1869759510512384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141741.149886:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141741.149917:0:8447:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141741.150017:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510512384 00000100:00100000:2.0:1783141741.150021:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510512384 00000100:00100000:2.0:1783141741.150049:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783141741.150055:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:8447:x1869759510512384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141741.150181:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:8447:x1869759510512384:12345-0@lo:502:llog_process_th.0 Request processed in 117us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141741.150188:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783141741.151192:0:8447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8447:1869759510512384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141741.151225:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141741.151232:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141741.151233:0:8447:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783141741.151237:0:8447:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783141741.151423:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783141741.151446:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141741.151477:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.151489:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141741.151499:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141741.151501:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff94649d28d000 from 4 10000000:01000000:1.0:1783141741.151504:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141741.151531:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.151540:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.151548:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141741.151578:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.151623:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.151657:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743b780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141741.152731:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510512512 00000100:00100000:0.0:1783141741.152740:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510512512 00000100:00100000:0.0:1783141741.152789:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783141741.152799:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510512512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141741.152815:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141741.152829:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89872e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.152852:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89872e expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.152863:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89872e expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141741.152871:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7e00, rc 0) 00000100:00100000:0.0:1783141741.152939:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510512512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141741.152946:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783141741.153120:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141741.153138:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.153147:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141741.153213:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.153243:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.153286:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743b780 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.153299:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510512640 00000100:00100000:1.0:1783141741.153303:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510512640 00000100:00100000:1.0:1783141741.153327:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783141741.153333:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510512640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.153603:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510512640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.153610:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783141741.153642:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.153666:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.153701:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.153726:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743b780 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.153743:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510512768 00000100:00100000:1.0:1783141741.153747:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510512768 00000100:00100000:1.0:1783141741.153767:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783141741.153773:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510512768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.153902:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510512768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.153908:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783141741.153944:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510512768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.154109:0:8448:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8448:1869759510512896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141741.154141:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.154156:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510512896 00000100:00100000:1.0:1783141741.154160:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510512896 00000100:00100000:1.0:1783141741.154191:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1783141741.154197:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:8448:x1869759510512896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141741.154301:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:8448:x1869759510512896:12345-0@lo:502:llog_process_th.0 Request processed in 104us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.154307:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1783141741.154334:0:8448:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.154345:0:8448:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8448:1869759510512896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141741.154364:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141741.154373:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141741.154376:0:8448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783141741.154384:0:8448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94649d28d000 00000020:00000080:1.0:1783141741.154386:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783141741.154442:0:8448:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8448:1869759510513024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141741.154495:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.154518:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510513024 00000100:00100000:1.0:1783141741.154521:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510513024 00000100:00100000:1.0:1783141741.154538:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783141741.154543:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:8448:x1869759510513024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141741.154632:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:8448:x1869759510513024:12345-0@lo:502:llog_process_th.0 Request processed in 88us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.154638:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783141741.154664:0:8448:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.154674:0:8448:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8448:1869759510513024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141741.154689:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141741.154692:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141741.154694:0:8448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783141741.154697:0:8448:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783141741.154741:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783141741.154753:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141741.154762:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.154771:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141741.154782:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141741.154784:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946489ce7800 from 4 10000000:01000000:1.0:1783141741.154787:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141741.154806:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.154814:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.154832:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141741.154844:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510513152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.154866:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.154878:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.154889:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510513152 00000100:00100000:1.0:1783141741.154892:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510513152 00000100:00100000:1.0:1783141741.154912:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783141741.154918:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510513152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141741.154924:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141741.154935:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89873c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.154954:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89873c expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.154964:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89873c expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.154972:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53000, rc 0) 00000100:00100000:1.0:1783141741.154999:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510513152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.155004:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783141741.155031:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510513152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141741.155043:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.155056:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141741.155095:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510513280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.155117:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.155128:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.155138:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510513280 00000100:00100000:1.0:1783141741.155140:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510513280 00000100:00100000:1.0:1783141741.155157:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783141741.155162:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510513280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.155368:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510513280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.155374:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783141741.155403:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510513280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.155426:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510513408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.155483:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.155497:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.155507:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510513408 00000100:00100000:1.0:1783141741.155511:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510513408 00000100:00100000:1.0:1783141741.155529:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783141741.155535:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510513408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.155639:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510513408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.155645:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783141741.155686:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510513408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141741.155921:0:8449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8449:1869759510513536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141741.155951:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.155968:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510513536 00000100:00100000:1.0:1783141741.155971:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510513536 00000100:00100000:1.0:1783141741.155990:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783141741.155996:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648762e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:8449:x1869759510513536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141741.156101:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648762e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:8449:x1869759510513536:12345-0@lo:502:llog_process_th.0 Request processed in 104us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.156108:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783141741.156134:0:8449:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743b300 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.156145:0:8449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8449:1869759510513536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141741.156164:0:8449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141741.183094:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141741.183102:0:8449:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783141741.183119:0:8449:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff946489ce7800 00000020:00000080:1.0:1783141741.183122:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783141741.183238:0:8449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8449:1869759510513664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141741.183312:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141741.183349:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510513664 00000100:00100000:1.0:1783141741.183356:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510513664 00000100:00100000:1.0:1783141741.183399:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1783141741.183408:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648762d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:8449:x1869759510513664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141741.183635:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648762d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:8449:x1869759510513664:12345-0@lo:502:llog_process_th.0 Request processed in 227us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141741.183643:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1783141741.183698:0:8449:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649743b300 going to sleep for 11 seconds 00000100:00100000:1.0:1783141741.183732:0:8449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:8449:1869759510513664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141741.183759:0:8449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141741.183764:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141741.183766:0:8449:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783141741.183770:0:8449:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783141741.183821:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783141741.183842:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141741.183852:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.183863:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141741.277719:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141742.298700:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141743.325691:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141743.840986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141743.841060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141743.841119:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141743.841150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141743.841229:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492659840 00000100:00100000:2.0:1783141743.841238:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492659840 00000100:00100000:2.0:1783141743.841298:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492659968 00000100:00100000:2.0:1783141743.841302:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492659968 00000100:00100000:2.0:1783141743.841333:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:2.0:1783141743.841342:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492659840:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141743.841414:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492659840:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 73us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141743.841421:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:2.0:1783141743.841448:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1783141743.841455:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492659968:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141743.841683:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492659968:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 227us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141743.841690:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00080000:0.0:1783141743.841754:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141743.841759:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141743.843066:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492659712 00000100:00100000:0.0:1783141743.843079:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492659712 00000100:00100000:0.0:1783141743.843148:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:0.0:1783141743.843169:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492659712:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141743.843226:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492659712:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 60us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141743.843234:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00080000:2.0:1783141743.843294:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141743.843446:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492659584 00000100:00100000:3.0:1783141743.843452:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492659584 00000100:00100000:3.0:1783141743.843511:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 190 00000100:00100000:3.0:1783141743.843519:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464851fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2369:x1869759492659584:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141743.843545:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464851fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2369:x1869759492659584:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141743.843552:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 190 00010000:00010000:2.0:1783141744.348169:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141744.666647:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510514176:0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.666715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141744.666808:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783141744.666815:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510513792:0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.666857:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141744.666903:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510514304:0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.666929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141744.666958:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510514048:0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.666982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141744.667020:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783141744.667026:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510513920:0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.667048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141744.667063:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510514432:0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.667081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141744.667106:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510513792 00000100:00100000:0.0:1783141744.667113:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510513792 00000100:00100000:0.0:1783141744.667167:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783141744.667176:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464851f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510513792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.667504:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464851f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510513792:12345-0@lo:400:kworker.0 Request processed in 328us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141744.667511:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783141744.667544:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510514304 00000100:00100000:0.0:1783141744.667548:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510514304 00000100:00100000:0.0:1783141744.667580:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510514048 00000100:00100000:0.0:1783141744.667582:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510514048 00000100:00100000:0.0:1783141744.667595:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510513920 00000100:00100000:0.0:1783141744.667597:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510513920 00000100:00100000:0.0:1783141744.667609:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783141744.667615:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510514304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.667646:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510514304:12345-0@lo:400:kworker.0 Request processed in 31us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141744.667653:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783141744.667663:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783141744.667669:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510514048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.667699:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510514048:12345-0@lo:400:kworker.0 Request processed in 31us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141744.667715:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783141744.667727:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783141744.667732:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510513920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.667761:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510513920:12345-0@lo:400:kworker.0 Request processed in 29us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141744.667766:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783141744.667793:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510514176 00000100:00100000:0.0:1783141744.667796:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510514176 00000100:00100000:0.0:1783141744.667835:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510514432 00000100:00100000:0.0:1783141744.667838:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510514432 00000100:00100000:0.0:1783141744.667853:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141744.667859:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510514176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.667888:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510514176:12345-0@lo:400:kworker.0 Request processed in 29us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141744.667967:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141744.667979:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141744.667985:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510514432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.668082:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510514432:12345-0@lo:400:kworker.0 Request processed in 97us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141744.668088:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141744.668138:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510513920:0@lo:400:kworker.0 00010000:00080000:0.0:1783141744.668168:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5e300 x1869759510514432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141744.668179:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510514432:0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.668259:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510514048:0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.668306:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510513792:0@lo:400:kworker.0 00000100:00100000:0.0:1783141744.668317:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510514304:0@lo:400:kworker.0 00010000:00080000:0.0:1783141744.668328:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5fb80 x1869759510514176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141744.668338:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510514176:0@lo:400:kworker.0 00000100:00080000:2.0:1783141744.668847:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141744.668853:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141744.668856:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141744.668888:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510514560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141744.669230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141744.670782:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510514560 00000100:00100000:2.0:1783141744.670795:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510514560 00000100:00100000:2.0:1783141744.670851:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783141744.670861:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510514560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141744.670898:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141744.670972:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510514560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141744.670979:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1783141744.671062:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5fb80 x1869759510514560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141744.671082:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510514560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141745.182575:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141745.182599:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510514688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141745.182692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141745.182927:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510514688 00000100:00100000:1.0:1783141745.182935:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510514688 00000100:00100000:1.0:1783141745.182985:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783141745.183001:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510514688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141745.183084:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141745.183136:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510514688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141745.183153:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1783141745.183182:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485192680 x1869759510514688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141745.183201:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510514688:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141745.375594:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141745.884646:0:8668:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1783141746.394766:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141747.419169:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141748.443774:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141748.954011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141748.954074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141748.954126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141748.954188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141748.954257:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492660480 00000100:00100000:2.0:1783141748.954269:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492660480 00000100:00100000:2.0:1783141748.954337:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492660352 00000100:00100000:2.0:1783141748.954342:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492660352 00000100:00100000:2.0:1783141748.954365:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:2.0:1783141748.954377:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492660480:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141748.954741:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492660480:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 364us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.954752:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:2.0:1783141748.954776:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1783141748.954783:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492660352:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141748.954812:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492660352:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141748.954818:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00080000:2.0:1783141748.954838:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141748.954843:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141748.955114:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492660224 00000100:00100000:3.0:1783141748.955140:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492660224 00000100:00100000:3.0:1783141748.955205:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:3.0:1783141748.955214:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492660224:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141748.955252:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492660224:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 39us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141748.955258:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00080000:1.0:1783141748.955363:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141748.955545:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492660096 00000100:00100000:1.0:1783141748.955557:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492660096 00000100:00100000:1.0:1783141748.955657:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 192 00000100:00100000:1.0:1783141748.955665:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2367:x1869759492660096:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141748.955698:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2367:x1869759492660096:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 34us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141748.955705:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 192 00010000:00010000:3.0:1783141749.471146:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141749.786707:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510514816:0@lo:400:kworker.0 00000100:00100000:3.0:1783141749.786910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141749.786975:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510515328:0@lo:400:kworker.0 00000100:00100000:3.0:1783141749.787004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141749.787032:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141749.787038:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510515200:0@lo:400:kworker.0 00000100:00100000:3.0:1783141749.787064:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141749.787091:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510515072:0@lo:400:kworker.0 00000100:00100000:3.0:1783141749.787126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141749.787145:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783141749.787150:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510514944:0@lo:400:kworker.0 00000100:00100000:3.0:1783141749.787171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141749.787187:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510515456:0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787198:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510515200 00000100:00100000:3.0:1783141749.787206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141749.787208:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510515200 00000100:00100000:3.0:1783141749.787230:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510514816 00000100:00100000:3.0:1783141749.787233:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510514816 00000100:00100000:2.0:1783141749.787267:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510515456 00000100:00100000:2.0:1783141749.787269:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510515456 00000100:00100000:3.0:1783141749.787272:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1783141749.787280:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510514816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787284:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783141749.787290:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510515200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787356:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510515200:12345-0@lo:400:kworker.0 Request processed in 66us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141749.787364:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783141749.787384:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783141749.787398:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510515456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787435:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510515456:12345-0@lo:400:kworker.0 Request processed in 38us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141749.787442:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1783141749.787488:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141749.787492:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783141749.787527:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648bf8fb80 x1869759510515456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141749.787543:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510515456:0@lo:400:kworker.0 00010000:00080000:2.0:1783141749.787573:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648bf8df80 x1869759510515200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141749.787582:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510515200:0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787622:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510515328 00000100:00100000:2.0:1783141749.787626:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510515328 00000100:00100000:2.0:1783141749.787660:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510515072 00000100:00100000:2.0:1783141749.787663:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510515072 00000100:00100000:2.0:1783141749.787676:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510514944 00000100:00100000:2.0:1783141749.787679:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510514944 00000100:00100000:2.0:1783141749.787692:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783141749.787698:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510515328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787737:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510515328:12345-0@lo:400:kworker.0 Request processed in 39us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141749.787745:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783141749.787757:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783141749.787763:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510515072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787794:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510515072:12345-0@lo:400:kworker.0 Request processed in 31us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141749.787807:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783141749.787819:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783141749.787824:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510514944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787851:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510514944:12345-0@lo:400:kworker.0 Request processed in 27us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141749.787856:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1783141749.787875:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141749.787899:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510514944:0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787909:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510515072:0@lo:400:kworker.0 00000100:00100000:2.0:1783141749.787937:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510515328:0@lo:400:kworker.0 00000100:00100000:3.0:1783141749.788066:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510514816:12345-0@lo:400:kworker.0 Request processed in 786us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141749.788073:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783141749.788131:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141749.788142:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510515584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141749.788180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141749.788210:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510515584 00000100:00100000:1.0:1783141749.788215:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510515584 00000100:00100000:1.0:1783141749.788244:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783141749.788250:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510515584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141749.788285:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141749.788321:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510515584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141749.788327:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1783141749.788357:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485190700 x1869759510515584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141749.788372:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510515584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141749.788442:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510514816:0@lo:400:kworker.0 00000100:00100000:0.0:1783141750.299953:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141750.299984:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510515712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141750.300156:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141750.301425:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510515712 00000100:00100000:1.0:1783141750.301440:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510515712 00000100:00100000:1.0:1783141750.301545:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783141750.301557:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510515712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141750.301609:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141750.301692:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510515712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141750.301710:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1783141750.306507:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485190700 x1869759510515712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141750.306887:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510515712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783141750.494043:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141751.075152:0:8911:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing yml_node 00010000:00010000:0.0:1783141751.518543:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141752.538712:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141753.562784:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141754.074040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141754.074140:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141754.075615:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492660736 00000100:00100000:2.0:1783141754.075628:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492660736 00000100:00100000:2.0:1783141754.075712:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1783141754.075724:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492660736:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141754.075805:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492660736:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 83us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141754.075813:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00080000:3.0:1783141754.077137:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141754.085181:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492660608 00000100:00100000:1.0:1783141754.085195:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492660608 00000100:00100000:1.0:1783141754.085273:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:1.0:1783141754.085286:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2366:x1869759492660608:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141754.085369:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2366:x1869759492660608:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 85us (11348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141754.085377:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:0.0:1783141754.086368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141754.086404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141754.086554:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492660864 00000100:00100000:3.0:1783141754.086563:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492660864 00000100:00100000:3.0:1783141754.086618:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492660992 00000100:00100000:3.0:1783141754.086622:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492660992 00000100:00100000:3.0:1783141754.086640:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:3.0:1783141754.086648:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2365:x1869759492660864:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:3.0:1783141754.086679:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da89867f 00000100:00080000:3.0:1783141754.086688:0:6584:0:(import.c:65:import_set_state_nolock()) ffff946381373800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141754.086726:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1783141754.086830:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141754.086833:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783141754.086859:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141754.087414:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+2:2365:x1869759492660864:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 762us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141754.087426:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:3.0:1783141754.087454:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:3.0:1783141754.087501:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2365:x1869759492660992:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:3.0:1783141754.087519:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898686 00000100:00080000:3.0:1783141754.087535:0:6584:0:(import.c:65:import_set_state_nolock()) ffff946381374000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141754.087558:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783141754.087742:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+2:2365:x1869759492660992:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 279us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141754.087749:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00010000:00010000:1.0:1783141754.089016:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141754.588257:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141754.906684:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510515840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141754.906757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141754.906839:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510515840 00000100:00100000:1.0:1783141754.906847:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510515840 00000100:00100000:1.0:1783141754.906897:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783141754.906906:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510515840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141754.906938:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141754.906982:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510515840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141754.906989:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1783141754.907032:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485190e00 x1869759510515840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141754.907066:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510515840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141754.908143:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510515968:0@lo:400:kworker.0 00000100:00100000:1.0:1783141754.908236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141754.908304:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510516480:0@lo:400:kworker.0 00000100:00100000:1.0:1783141754.908337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141754.908366:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141754.908372:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510516096:0@lo:400:kworker.0 00000100:00100000:1.0:1783141754.908400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141754.908451:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510516096 00000100:00100000:1.0:1783141754.908486:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510516096 00000100:00100000:2.0:1783141754.908503:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510515968 00000100:00100000:2.0:1783141754.908512:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510515968 00000100:00100000:2.0:1783141754.908573:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1783141754.908595:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510515968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141754.908665:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510515968:12345-0@lo:400:kworker.0 Request processed in 71us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141754.908673:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783141754.908731:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783141754.908744:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510516096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141754.909374:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510516224:0@lo:400:kworker.0 00000100:00100000:3.0:1783141754.909426:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141754.909456:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141754.909505:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510516352:0@lo:400:kworker.0 00000100:00100000:1.0:1783141754.909684:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510516096:12345-0@lo:400:kworker.0 Request processed in 942us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141754.909694:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783141754.909717:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510516224 00000100:00100000:1.0:1783141754.909722:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510516224 00000100:00100000:2.0:1783141754.909830:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783141754.909841:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510516224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141754.909880:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510516224:12345-0@lo:400:kworker.0 Request processed in 41us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141754.909886:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783141754.910678:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510516096:0@lo:400:kworker.0 00000100:00100000:1.0:1783141754.910697:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510515968:0@lo:400:kworker.0 00000100:00100000:3.0:1783141754.910794:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141754.910841:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510516224:0@lo:400:kworker.0 00000100:00100000:3.0:1783141754.910865:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510516352 00000100:00100000:3.0:1783141754.910870:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510516352 00000100:00100000:3.0:1783141754.910910:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783141754.910917:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510516352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141754.910972:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510516352:12345-0@lo:400:kworker.0 Request processed in 54us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141754.910979:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783141754.911007:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510516352:0@lo:400:kworker.0 00000100:00080000:0.0:1783141754.915350:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783141754.915360:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141754.915379:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510516480 00000100:00100000:0.0:1783141754.915388:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510516480 00000100:00100000:0.0:1783141754.915503:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141754.915516:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510516480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141754.915633:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510516480:12345-0@lo:400:kworker.0 Request processed in 120us (7294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141754.915655:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1783141754.915683:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783141754.915713:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464baa22300 x1869759510516480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141754.915729:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510516480:0@lo:400:kworker.0 00000100:00100000:2.0:1783141755.420751:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510516608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141755.421421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141755.421600:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510516608 00000100:00100000:1.0:1783141755.421611:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510516608 00000100:00100000:1.0:1783141755.421684:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783141755.421695:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510516608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141755.421744:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141755.421799:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510516608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (382us total) trans 0 rc 0/0 00010000:00080000:2.0:1783141755.422798:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485191c00 x1869759510516608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141755.422950:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783141755.423137:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510516608:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1783141755.570010:0:9104:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.86 00010000:00010000:3.0:1783141755.611175:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783141756.001875:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000020:00000080:3.0:1783141756.001884:0:6610:0:(genops.c:906:class_export_put()) final put ffff946381370000/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000020:00000080:2.0:1783141756.005082:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff946381370000/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 for lustre-OST0000 00000020:00000080:2.0:1783141756.005212:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946381373800 for lustre-OST0000 00010000:00010000:3.0:1783141756.641296:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141757.662720:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783141758.563591:0:9203:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.86 00000001:00100000:1.0:1783141758.569850:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000020:00000080:1.0:1783141758.569861:0:7506:0:(genops.c:906:class_export_put()) final put ffff946381376000/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000020:00000080:3.0:1783141758.569996:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff946381376000/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 for lustre-OST0001 00000020:00000080:3.0:1783141758.570272:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946381374000 for lustre-OST0001 00010000:00010000:3.0:1783141758.689067:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141759.193742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141759.193796:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141759.193838:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492661248 00000100:00100000:2.0:1783141759.193850:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492661248 00000100:00100000:2.0:1783141759.193927:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:2.0:1783141759.193939:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492661248:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141759.194037:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492661248:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141759.194073:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00080000:2.0:1783141759.194106:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141759.195280:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492661120 00000100:00100000:1.0:1783141759.195294:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492661120 00000100:00100000:1.0:1783141759.195364:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:1.0:1783141759.195375:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2366:x1869759492661120:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141759.195447:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2366:x1869759492661120:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 74us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141759.195454:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 196 00010000:00010000:3.0:1783141759.707125:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141760.027527:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510517120:0@lo:400:kworker.0 00000100:00100000:2.0:1783141760.027627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141760.027710:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783141760.027717:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510516992:0@lo:400:kworker.0 00000100:00100000:2.0:1783141760.027746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141760.027767:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baa21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510517504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141760.027791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141760.027826:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510516992 00000100:00100000:2.0:1783141760.027835:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510516992 00000100:00100000:2.0:1783141760.027902:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783141760.027913:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510516992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141760.027976:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510516992:12345-0@lo:400:kworker.0 Request processed in 64us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141760.027985:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783141760.028012:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510517504 00000100:00100000:2.0:1783141760.028017:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510517504 00000100:00100000:2.0:1783141760.028059:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783141760.028066:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510517504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141760.028110:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141760.028140:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510517504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141760.028146:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1783141760.028161:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141760.028165:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141760.028212:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510516992:0@lo:400:kworker.0 00010000:00080000:2.0:1783141760.028227:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464baa21180 x1869759510517504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141760.028243:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baa21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510517504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141760.028492:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510517120 00000100:00100000:1.0:1783141760.028497:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510517120 00000100:00100000:1.0:1783141760.028532:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783141760.028541:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510517120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141760.028582:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510517120:12345-0@lo:400:kworker.0 Request processed in 42us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141760.028588:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783141760.028772:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510516736:0@lo:400:kworker.0 00000100:00100000:3.0:1783141760.028815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141760.028844:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510517248:0@lo:400:kworker.0 00000100:00100000:3.0:1783141760.028867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141760.028886:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783141760.028892:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510516864:0@lo:400:kworker.0 00000100:00100000:3.0:1783141760.028912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141760.028926:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510517376:0@lo:400:kworker.0 00000100:00100000:3.0:1783141760.028948:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141760.028984:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510517376 00000100:00100000:3.0:1783141760.028988:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510517376 00000100:00100000:3.0:1783141760.029017:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783141760.029024:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510517376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141760.029070:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510517376:12345-0@lo:400:kworker.0 Request processed in 46us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141760.029154:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510516736 00000100:00100000:1.0:1783141760.029158:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510516736 00000100:00100000:1.0:1783141760.029186:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783141760.029192:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510516736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141760.029224:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510516736:12345-0@lo:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141760.029230:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783141760.029289:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1783141760.029322:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876ea300 x1869759510517376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141760.029334:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510517376:0@lo:400:kworker.0 00000100:00100000:3.0:1783141760.029342:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510516736:0@lo:400:kworker.0 00000100:00100000:2.0:1783141760.029807:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510517248 00000100:00100000:2.0:1783141760.029814:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510517248 00000100:00100000:2.0:1783141760.029854:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510516864 00000100:00100000:2.0:1783141760.029857:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510516864 00000100:00100000:2.0:1783141760.029876:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783141760.029885:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510517248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141760.029936:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510517248:12345-0@lo:400:kworker.0 Request processed in 53us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141760.029943:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783141760.029955:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783141760.029961:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510516864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141760.029988:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510516864:12345-0@lo:400:kworker.0 Request processed in 27us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141760.029994:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1783141760.030014:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141760.030018:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141760.030237:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510516864:0@lo:400:kworker.0 00000100:00100000:2.0:1783141760.030251:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510517248:0@lo:400:kworker.0 00010000:00080000:2.0:1783141760.030287:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876e8e00 x1869759510517120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141760.030297:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510517120:0@lo:400:kworker.0 00000100:00100000:3.0:1783141760.539114:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141760.539148:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510517632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141760.539246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141760.539453:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510517632 00000100:00100000:1.0:1783141760.539515:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510517632 00000100:00100000:1.0:1783141760.539583:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783141760.539594:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510517632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141760.539640:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141760.539697:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510517632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141760.539713:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1783141760.539776:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5c380 x1869759510517632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141760.539798:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510517632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141760.744173:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141761.636183:0:9302:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.86 00010000:00010000:0.0:1783141761.754812:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141762.779296:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141763.808586:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783141763.867445:0:9350:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Jul 4 01:09:21 EDT 2026 00000100:00100000:2.0:1783141764.319152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141764.319190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141764.319339:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492661376 00000100:00100000:0.0:1783141764.319349:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492661376 00000100:00100000:0.0:1783141764.319398:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 198 00000100:00100000:0.0:1783141764.319406:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2366:x1869759492661376:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141764.319499:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2366:x1869759492661376:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 93us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141764.319506:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 198 00000100:00100000:3.0:1783141764.319578:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492661504 00000100:00100000:3.0:1783141764.319582:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492661504 00000100:00100000:3.0:1783141764.319627:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:3.0:1783141764.319634:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492661504:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141764.319662:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492661504:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141764.319668:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00080000:0.0:1783141764.319769:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783141764.827505:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141765.146892:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141765.146932:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510517760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141765.147030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141765.147294:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510517760 00000100:00100000:2.0:1783141765.147305:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510517760 00000100:00100000:2.0:1783141765.147386:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783141765.147397:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510517760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141765.147444:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141765.147530:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510517760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141765.147614:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1783141765.147670:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648bf8d880 x1869759510517760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141765.147691:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510517760:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783141765.147788:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141765.149894:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510518144:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141765.150102:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141765.150111:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510518016:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141765.150173:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510518144 00000100:00100000:2.0:1783141765.150180:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510518144 00000100:00100000:2.0:1783141765.150235:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510518016 00000100:00100000:2.0:1783141765.150238:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510518016 00000100:00100000:2.0:1783141765.150260:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783141765.150269:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510518144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150320:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510518144:12345-0@lo:400:kworker.0 Request processed in 53us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141765.150338:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783141765.150353:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783141765.150358:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510518016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150386:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510518016:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141765.150391:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783141765.150549:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510518016:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150558:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510518144:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150585:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510518272:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150607:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141765.150624:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783141765.150629:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510517888:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141765.150676:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510518400:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150697:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141765.150718:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510518272 00000100:00100000:2.0:1783141765.150721:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510518272 00000100:00100000:2.0:1783141765.150741:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783141765.150746:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510518272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150776:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510518272:12345-0@lo:400:kworker.0 Request processed in 30us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141765.150781:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783141765.150796:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510517888 00000100:00100000:2.0:1783141765.150799:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510517888 00000100:00100000:2.0:1783141765.150829:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1783141765.150837:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510517888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.150872:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510517888:12345-0@lo:400:kworker.0 Request processed in 37us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141765.150880:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1783141765.150916:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510518400 00000100:00100000:2.0:1783141765.150920:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510518400 00000100:00100000:2.0:1783141765.150945:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783141765.150951:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510518400:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783141765.151389:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141765.151398:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141765.153148:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510517888:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.153221:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510518400:12345-0@lo:400:kworker.0 Request processed in 2260us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141765.153234:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1783141765.153307:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485191c00 x1869759510518400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141765.153323:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510518400:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.153339:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510518272:0@lo:400:kworker.0 00000100:00100000:2.0:1783141765.659607:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510518528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141765.659716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141765.659854:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510518528 00000100:00100000:3.0:1783141765.659865:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510518528 00000100:00100000:3.0:1783141765.659931:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783141765.659942:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510518528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141765.659987:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141765.660065:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510518528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141765.660074:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1783141765.660347:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5c380 x1869759510518528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141765.660397:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510518528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141765.851518:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141766.888347:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141767.899913:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141768.927709:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141769.433321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141769.433372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141769.433560:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492661632 00000100:00100000:2.0:1783141769.433573:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492661632 00000100:00100000:2.0:1783141769.433638:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:2.0:1783141769.433648:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2366:x1869759492661632:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141769.433737:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2366:x1869759492661632:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 90us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141769.433764:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:0.0:1783141769.434034:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492661760 00000100:00100000:0.0:1783141769.434039:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492661760 00000100:00100000:0.0:1783141769.434088:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:0.0:1783141769.434095:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492661760:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141769.434130:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492661760:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 36us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141769.434136:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00080000:1.0:1783141769.434185:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783141769.955247:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141770.272867:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141770.273362:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510518784:0@lo:400:kworker.0 00000100:00100000:3.0:1783141770.273454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141770.273542:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141770.273549:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510518912:0@lo:400:kworker.0 00000100:00100000:3.0:1783141770.273602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141770.278539:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510519040:0@lo:400:kworker.0 00000100:00100000:1.0:1783141770.278643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141770.278704:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510518656:0@lo:400:kworker.0 00000100:00100000:1.0:1783141770.278736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141770.278762:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141770.278769:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510519168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141770.278792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141770.278828:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510519040 00000100:00100000:1.0:1783141770.278839:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510519040 00000100:00100000:1.0:1783141770.278902:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783141770.278913:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510519040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141770.278990:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510519040:12345-0@lo:400:kworker.0 Request processed in 78us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141770.278998:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783141770.279027:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510518656 00000100:00100000:1.0:1783141770.279031:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510518656 00000100:00100000:1.0:1783141770.279058:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783141770.279064:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510518656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141770.279096:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510518656:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141770.279102:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783141770.279146:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510519168 00000100:00100000:1.0:1783141770.279156:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510519168 00000100:00100000:1.0:1783141770.279190:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783141770.279197:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510519168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141770.279231:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141770.280055:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510519168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141770.280070:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1783141770.280103:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783141770.280153:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497264700 x1869759510519168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141770.280177:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510519168:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1783141770.280190:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5fb80 x1869759510519040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141770.280198:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510519040:0@lo:400:kworker.0 00000100:00100000:1.0:1783141770.280206:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510518656:0@lo:400:kworker.0 00000100:00100000:0.0:1783141770.280709:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510519296:0@lo:400:kworker.0 00000100:00100000:0.0:1783141770.280766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141770.280811:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510518784 00000100:00100000:0.0:1783141770.280817:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510518784 00000100:00100000:0.0:1783141770.280853:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510518912 00000100:00100000:0.0:1783141770.280856:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510518912 00000100:00100000:0.0:1783141770.280878:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510519296 00000100:00100000:0.0:1783141770.280881:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510519296 00000100:00100000:0.0:1783141770.280898:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783141770.280905:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510518784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141770.280956:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510518784:12345-0@lo:400:kworker.0 Request processed in 50us (7503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141770.280962:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783141770.280988:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783141770.280995:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510518912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141770.281049:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510518912:12345-0@lo:400:kworker.0 Request processed in 55us (7447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141770.281055:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783141770.281067:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783141770.281073:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510519296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141770.281100:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510519296:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141770.281105:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1783141770.281118:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141770.281143:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510519296:0@lo:400:kworker.0 00000100:00100000:0.0:1783141770.281156:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510518912:0@lo:400:kworker.0 00000100:00100000:0.0:1783141770.281167:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510518784:0@lo:400:kworker.0 00000100:00100000:0.0:1783141770.281207:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510519424:0@lo:400:kworker.0 00000100:00100000:0.0:1783141770.281233:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141770.284424:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510519424 00000100:00100000:2.0:1783141770.284443:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510519424 00000100:00100000:2.0:1783141770.284532:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783141770.284545:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510519424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141770.284659:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510519424:12345-0@lo:400:kworker.0 Request processed in 116us (3423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141770.284667:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1783141770.284691:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783141770.284736:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464bfc5ed80 x1869759510519424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141770.284754:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510519424:0@lo:400:kworker.0 00000100:00100000:2.0:1783141770.785984:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510519552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141770.786066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141770.786362:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510519552 00000100:00100000:1.0:1783141770.786371:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510519552 00000100:00100000:1.0:1783141770.786425:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783141770.786434:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510519552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141770.786488:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141770.786539:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510519552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141770.786547:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1783141770.786718:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876e9500 x1869759510519552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141770.786753:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510519552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783141770.977684:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141771.995814:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141773.019232:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141774.042773:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141774.566974:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141774.567014:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141774.567039:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492661888 00000100:00100000:1.0:1783141774.567047:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492661888 00000100:00100000:1.0:1783141774.567093:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:1.0:1783141774.567103:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2368:x1869759492661888:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141774.569660:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2368:x1869759492661888:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 2551us (2637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141774.569675:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:0.0:1783141774.574767:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492662016 00000100:00100000:0.0:1783141774.574780:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492662016 00000100:00100000:0.0:1783141774.574899:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:0.0:1783141774.574911:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492662016:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141774.575003:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492662016:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 94us (8039us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141774.575011:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00080000:2.0:1783141774.575409:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783141775.066673:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141775.386709:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510519680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141775.386780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141775.387221:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510519936:0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141775.387275:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783141775.387280:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510519808:0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387306:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141775.387327:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510520320:0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141775.387375:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510519936 00000100:00100000:1.0:1783141775.387382:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510519936 00000100:00100000:1.0:1783141775.387438:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141775.387448:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510519936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387519:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510519936:12345-0@lo:400:kworker.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141775.387539:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141775.387560:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510519808 00000100:00100000:1.0:1783141775.387563:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510519808 00000100:00100000:1.0:1783141775.387583:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783141775.387589:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510519808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387616:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510519808:12345-0@lo:400:kworker.0 Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141775.387622:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783141775.387643:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510520320 00000100:00100000:1.0:1783141775.387646:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510520320 00000100:00100000:1.0:1783141775.387675:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783141775.387680:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510520320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387705:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510520320:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141775.387711:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1783141775.387730:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141775.387742:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510520064:0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141775.387777:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141775.387781:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510520192:0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141775.387817:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510520064 00000100:00100000:1.0:1783141775.387819:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510520064 00000100:00100000:1.0:1783141775.387850:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510520192 00000100:00100000:1.0:1783141775.387852:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510520192 00000100:00100000:1.0:1783141775.387867:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783141775.387872:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510520064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387910:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510520064:12345-0@lo:400:kworker.0 Request processed in 38us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141775.387916:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783141775.387937:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783141775.387944:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510520192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.387970:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510520192:12345-0@lo:400:kworker.0 Request processed in 27us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141775.387975:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1783141775.387990:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141775.388022:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510520192:0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.388032:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510520064:0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.388056:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510519808:0@lo:400:kworker.0 00010000:00080000:1.0:1783141775.388067:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876e8a80 x1869759510520320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141775.388076:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510520320:0@lo:400:kworker.0 00000100:00100000:1.0:1783141775.388084:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510519936:0@lo:400:kworker.0 00000100:00100000:3.0:1783141775.388320:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510519680 00000100:00100000:3.0:1783141775.388326:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510519680 00000100:00100000:3.0:1783141775.388365:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783141775.388372:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510519680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141775.388399:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141775.388435:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510519680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141775.388441:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1783141775.389098:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783141775.389456:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497266a00 x1869759510519680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141775.393763:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510519680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141775.900102:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510520448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141775.900180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141775.900395:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510520448 00000100:00100000:1.0:1783141775.900403:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510520448 00000100:00100000:1.0:1783141775.900452:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783141775.900494:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510520448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141775.900530:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141775.900574:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510520448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141775.900581:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1783141775.900673:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876eaa00 x1869759510520448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141775.900692:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510520448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141776.091576:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141777.114683:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141778.138899:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141779.162714:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141779.686434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141779.686526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141779.686777:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492662272 00000100:00100000:2.0:1783141779.686790:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492662272 00000100:00100000:2.0:1783141779.686928:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:2.0:1783141779.686941:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492662272:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141779.687038:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492662272:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 99us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141779.687047:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:3.0:1783141779.687359:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492662144 00000100:00100000:3.0:1783141779.687365:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492662144 00000100:00100000:3.0:1783141779.687399:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00100000:3.0:1783141779.687407:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2369:x1869759492662144:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141779.687447:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2369:x1869759492662144:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 41us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141779.687454:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00080000:0.0:1783141779.687634:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1783141780.017346:0:9979:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:09:38 (1783141778) === 00010000:00010000:3.0:1783141780.187757:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141780.506872:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510520832:0@lo:400:kworker.0 00000100:00100000:1.0:1783141780.507073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141780.507159:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510520704:0@lo:400:kworker.0 00000100:00100000:1.0:1783141780.507164:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141780.507169:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510520960:0@lo:400:kworker.0 00000100:00100000:0.0:1783141780.507193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141780.507194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141780.507214:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510521216:0@lo:400:kworker.0 00000100:00100000:2.0:1783141780.507277:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510520576:0@lo:400:kworker.0 00000100:00100000:1.0:1783141780.507595:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510520832 00000100:00100000:1.0:1783141780.507604:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510520832 00000100:00100000:1.0:1783141780.507670:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510520704 00000100:00100000:1.0:1783141780.507674:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510520704 00000100:00100000:1.0:1783141780.507700:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783141780.507709:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510520832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141780.507776:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510520832:12345-0@lo:400:kworker.0 Request processed in 68us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.507784:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783141780.507803:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783141780.507809:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510520704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141780.507839:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510520704:12345-0@lo:400:kworker.0 Request processed in 30us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.507845:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783141780.507867:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510520960 00000100:00100000:1.0:1783141780.507871:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510520960 00000100:00100000:3.0:1783141780.508572:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141780.508588:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510521344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141780.508651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141780.508735:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510521344 00000100:00100000:3.0:1783141780.508741:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510521344 00000100:00100000:3.0:1783141780.508782:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783141780.508790:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869759510521344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141780.508829:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141780.508869:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869759510521344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141780.508876:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1783141780.508932:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497267100 x1869759510521344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141780.508952:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510521344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141780.509313:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783141780.509331:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510520960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141780.509373:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510520960:12345-0@lo:400:kworker.0 Request processed in 43us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.509388:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1783141780.509438:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876eb100 x1869759510520960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141780.509449:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510520960:0@lo:400:kworker.0 00000100:00080000:3.0:1783141780.509644:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141780.509650:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141780.509751:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510520832:0@lo:400:kworker.0 00000100:00100000:0.0:1783141780.511166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141780.511232:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510520704:0@lo:400:kworker.0 00000100:00100000:2.0:1783141780.511600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141780.511652:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510521088:0@lo:400:kworker.0 00000100:00100000:2.0:1783141780.511685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141780.511701:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510521216 00000100:00100000:1.0:1783141780.511709:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510521216 00000100:00100000:0.0:1783141780.511785:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510520576 00000100:00100000:0.0:1783141780.511790:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510520576 00000100:00080000:3.0:1783141780.511832:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141780.511848:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510521088 00000100:00100000:3.0:1783141780.511851:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510521088 00000100:00100000:0.0:1783141780.511968:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1783141780.511978:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510520576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141780.512031:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510520576:12345-0@lo:400:kworker.0 Request processed in 55us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141780.512039:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1783141780.512079:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510520576:0@lo:400:kworker.0 00000100:00100000:0.0:1783141780.512108:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783141780.512115:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510521088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141780.512207:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510521088:12345-0@lo:400:kworker.0 Request processed in 92us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141780.512214:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783141780.512239:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510521088:0@lo:400:kworker.0 00000100:00100000:1.0:1783141780.514254:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783141780.514280:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510521216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141780.514412:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510521216:12345-0@lo:400:kworker.0 Request processed in 143us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.514420:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1783141780.516114:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783141780.516682:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876e9880 x1869759510521216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141780.516702:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510521216:0@lo:400:kworker.0 00000100:00100000:0.0:1783141780.557393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141780.557613:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492662400 00000100:00100000:2.0:1783141780.557625:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492662400 00000100:00100000:2.0:1783141780.557691:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:2.0:1783141780.557703:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:8102:x1869759492662400:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783141780.557725:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141780.557746:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a1a00/0x279ffa91da89874a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fcff expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141780.557782:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a1a00/0x279ffa91da89874a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcff expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141780.557807:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a1a00/0x279ffa91da89874a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcff expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141780.557820:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1a00, rc 0) 00000100:00100000:2.0:1783141780.558099:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8102:x1869759492662400:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 396us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141780.558107:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:3.0:1783141780.572713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141780.575771:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492662528 00000100:00100000:0.0:1783141780.575843:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492662528 00000100:00100000:1.0:1783141780.576242:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 207 00000100:00100000:1.0:1783141780.576256:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8102:x1869759492662528:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783141780.577154:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8102:x1869759492662528:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 895us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.577166:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 207 00000100:00100000:1.0:1783141780.587824:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141780.587944:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492662656 00000100:00100000:0.0:1783141780.587958:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492662656 00000100:00100000:0.0:1783141780.588024:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 208 00000100:00100000:0.0:1783141780.588036:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8102:x1869759492662656:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783141780.588337:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8102:x1869759492662656:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 302us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141780.588347:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 208 00000100:00100000:0.0:1783141780.602205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141780.602363:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492662784 00000100:00100000:1.0:1783141780.602376:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492662784 00000100:00100000:1.0:1783141780.602443:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 209 00000100:00100000:1.0:1783141780.602454:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8106:x1869759492662784:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783141780.603055:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8106:x1869759492662784:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 599us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.603066:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 209 00000100:00100000:3.0:1783141780.636732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141780.637290:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492662912 00000100:00100000:2.0:1783141780.637302:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492662912 00000100:00100000:2.0:1783141780.637371:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00100000:2.0:1783141780.637383:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8106:x1869759492662912:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783141780.637833:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8106:x1869759492662912:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 449us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141780.637842:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00100000:2.0:1783141780.667513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141780.667670:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492663040 00000100:00100000:0.0:1783141780.667682:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492663040 00000100:00100000:0.0:1783141780.667752:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 211 00000100:00100000:0.0:1783141780.667763:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:8102:x1869759492663040:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783141780.667784:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141780.668051:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94649d0d6000/0x279ffa91da898751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd29 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141780.668093:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d6000/0x279ffa91da898751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd29 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141780.668107:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94649d0d6000/0x279ffa91da898751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd29 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141780.668136:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6000, rc 0) 00000100:00100000:0.0:1783141780.668324:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:8102:x1869759492663040:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 562us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141780.668333:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 211 00000100:00100000:0.0:1783141780.677388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141780.677501:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492663168 00000100:00100000:1.0:1783141780.677514:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492663168 00000100:00100000:1.0:1783141780.677582:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 212 00000100:00100000:1.0:1783141780.677593:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:8102:x1869759492663168:12345-192.168.203.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783141780.677630:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783141780.677659:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783141780.677664:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783141780.677668:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783141780.677671:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1783141780.685350:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:8102:x1869759492663168:12345-192.168.203.27@tcp:256:mount.lustre.0 Request processed in 7742us (7960us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.685369:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 212 00000100:00100000:3.0:1783141780.688088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141780.688377:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492663296 00000100:00100000:0.0:1783141780.688391:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492663296 00000100:00100000:0.0:1783141780.688455:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 213 00000100:00100000:0.0:1783141780.688508:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:8102:x1869759492663296:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783141780.688537:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141780.688559:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd30 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141780.688593:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd30 expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141780.688605:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd30 expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141780.688616:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6800, rc 0) 00000100:00100000:0.0:1783141780.688679:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:8102:x1869759492663296:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 174us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141780.688687:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 213 00000100:00100000:0.0:1783141780.697525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141780.697668:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492663424 00000100:00100000:1.0:1783141780.697681:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492663424 00000100:00100000:1.0:1783141780.697745:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 214 00000100:00100000:1.0:1783141780.697756:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:8102:x1869759492663424:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783141780.698138:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:8102:x1869759492663424:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 381us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.698155:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 214 00000100:00100000:3.0:1783141780.707609:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141780.707731:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492663552 00000100:00100000:2.0:1783141780.707745:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492663552 00000100:00100000:2.0:1783141780.707817:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 215 00000100:00100000:2.0:1783141780.707829:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:8102:x1869759492663552:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783141780.708301:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:8102:x1869759492663552:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 472us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141780.708318:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 215 00000100:00100000:3.0:1783141780.714742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141780.715318:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492663680 00000100:00100000:0.0:1783141780.715332:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492663680 00000100:00100000:0.0:1783141780.715434:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 216 00000100:00100000:0.0:1783141780.715445:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:8111:x1869759492663680:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783141780.715806:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:8111:x1869759492663680:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 349us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141780.715817:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 216 00000100:00100000:2.0:1783141780.737640:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141780.737762:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492663808 00000100:00100000:1.0:1783141780.737777:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492663808 00000100:00100000:1.0:1783141780.737958:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 217 00000100:00100000:1.0:1783141780.737971:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:8111:x1869759492663808:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783141780.739679:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:8111:x1869759492663808:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 1697us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.739694:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 217 00000100:00100000:2.0:1783141780.755183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141780.755270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141780.755757:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492663936 00000100:00100000:3.0:1783141780.755771:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492663936 00000100:00100000:1.0:1783141780.759850:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492664320 00000100:00100000:1.0:1783141780.759871:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492664320 00000100:00100000:1.0:1783141780.760082:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:1.0:1783141780.760094:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492664320:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141780.760227:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492664320:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 133us (4954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.760235:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:2.0:1783141780.761115:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:2.0:1783141780.761125:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2365:x1869759492663936:12345-192.168.203.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783141780.761157:0:5786:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 20702fa5-92e9-446c-b215-c14c139e5a0c@192.168.203.27@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:2.0:1783141780.761203:0:5786:0:(genops.c:1406:class_connect()) connect: client 20702fa5-92e9-446c-b215-c14c139e5a0c, cookie 0x279ffa91da89875f 00000004:00100000:2.0:1783141780.761242:0:5786:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783141780.761854:0:5786:0:(import.c:65:import_set_state_nolock()) ffff946489d4b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141780.762075:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2365:x1869759492663936:12345-192.168.203.27@tcp:38:mount.lustre.0 Request processed in 949us (6906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141780.762085:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:3.0:1783141780.766242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141780.768123:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492664064 00000100:00100000:1.0:1783141780.768144:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492664064 00000100:00100000:1.0:1783141780.768263:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:1.0:1783141780.768276:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+6:0:x1869759492664064:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783141780.768344:0:7171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783141780.769628:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+6:0:x1869759492664064:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 187us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.769643:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00080000:3.0:1783141780.769807:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141780.774883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141780.774974:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492664192 00000100:00100000:1.0:1783141780.775450:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492664192 00000100:00100000:1.0:1783141780.775659:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:1.0:1783141780.775672:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+6:8102:x1869759492664192:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783141780.775722:0:5788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783141780.775819:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+6:8102:x1869759492664192:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 149us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.775846:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:3.0:1783141780.784276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141780.788071:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492664448 00000100:00100000:0.0:1783141780.788095:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492664448 00000100:00100000:0.0:1783141780.788395:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:0.0:1783141780.788408:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+6:8102:x1869759492664448:12345-192.168.203.27@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783141780.788562:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+6:8102:x1869759492664448:12345-192.168.203.27@tcp:40:mount.lustre.0 Request processed in 155us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141780.788571:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:3.0:1783141780.792374:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141780.792426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141780.792519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141780.792545:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141780.792575:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141780.792627:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492664960 00000100:00100000:3.0:1783141780.792639:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492664960 00000100:00100000:3.0:1783141780.792694:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 218 00000100:00100000:3.0:1783141780.792706:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492664960:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141780.792792:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492664960:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141780.792802:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 218 00000100:00100000:0.0:1783141780.793356:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492664576 00000100:00100000:0.0:1783141780.793363:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492664576 00000100:00100000:0.0:1783141780.793400:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492664704 00000100:00100000:0.0:1783141780.793402:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492664704 00000100:00100000:0.0:1783141780.793416:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:0.0:1783141780.793422:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869759492664576:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783141780.793456:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 20702fa5-92e9-446c-b215-c14c139e5a0c@192.168.203.27@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:0.0:1783141780.793583:0:6586:0:(genops.c:1406:class_connect()) connect: client 20702fa5-92e9-446c-b215-c14c139e5a0c, cookie 0x279ffa91da898766 00002000:00100000:0.0:1783141780.793647:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 20702fa5-92e9-446c-b215-c14c139e5a0c/ffff94649d12c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783141780.793662:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783141780.793953:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1783141780.794193:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492664832 00000100:00100000:1.0:1783141780.794200:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492664832 00000100:00100000:1.0:1783141780.794248:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:1.0:1783141780.794257:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+6:8102:x1869759492664832:12345-192.168.203.27@tcp:33:mount.lustre.0 00000004:00200000:1.0:1783141780.794727:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1783141780.794903:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+6:8102:x1869759492664832:12345-192.168.203.27@tcp:33:mount.lustre.0 Request processed in 634us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141780.794912:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:1.0:1783141780.794939:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492665088 00000100:00100000:1.0:1783141780.794944:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492665088 00000100:00100000:2.0:1783141780.795115:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:2.0:1783141780.795135:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492665088:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141780.795172:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492665088:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 40us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141780.795178:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00080000:0.0:1783141780.795701:0:6586:0:(import.c:65:import_set_state_nolock()) ffff94649d12e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141780.795753:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2365:x1869759492664576:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 2329us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141780.795770:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:0.0:1783141780.795793:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:0.0:1783141780.797373:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869759492664704:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783141780.798049:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 20702fa5-92e9-446c-b215-c14c139e5a0c@192.168.203.27@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1783141780.798094:0:6586:0:(genops.c:1406:class_connect()) connect: client 20702fa5-92e9-446c-b215-c14c139e5a0c, cookie 0x279ffa91da89876d 00002000:00100000:0.0:1783141780.798112:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 20702fa5-92e9-446c-b215-c14c139e5a0c/ffff94649d12e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783141780.798141:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783141780.798426:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783141780.799950:0:6586:0:(import.c:65:import_set_state_nolock()) ffff94649d129000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141780.800090:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2365:x1869759492664704:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 4284us (7565us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141780.800104:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1783141781.018998:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141781.019028:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510521472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141781.019123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141781.020001:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510521472 00000100:00100000:0.0:1783141781.020014:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510521472 00000100:00100000:0.0:1783141781.020083:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783141781.020094:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510521472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141781.020128:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141781.020209:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510521472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141781.020217:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1783141781.020645:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876e8000 x1869759510521472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141781.020668:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510521472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141781.212157:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783141781.644926:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20702fa5-92e9-446c-b215-c14c139e5a0c 00010000:00010000:0.0:1783141782.243988:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141783.265557:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783141783.623865:0:5809:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 20702fa5-92e9-446c-b215-c14c139e5a0c 00000001:00100000:1.0:1783141784.176488:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20702fa5-92e9-446c-b215-c14c139e5a0c 00010000:00010000:0.0:1783141784.287042:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141785.307440:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141785.626812:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510521728:0@lo:400:kworker.0 00000100:00100000:1.0:1783141785.626888:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141785.626956:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510522240:0@lo:400:kworker.0 00000100:00100000:1.0:1783141785.626986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141785.627020:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783141785.627028:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510521600:0@lo:400:kworker.0 00000100:00100000:3.0:1783141785.627048:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510521856:0@lo:400:kworker.0 00000100:00100000:1.0:1783141785.627059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141785.627125:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510521728 00000100:00100000:0.0:1783141785.627139:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510521728 00000100:00100000:0.0:1783141785.627191:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783141785.627200:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510521728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141785.627384:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510522240 00000100:00100000:2.0:1783141785.627389:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510522240 00000100:00100000:2.0:1783141785.627428:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783141785.627435:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510522240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141785.629011:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510522112:0@lo:400:kworker.0 00000100:00100000:3.0:1783141785.629019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141785.629060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141785.629061:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141785.629071:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510521984:0@lo:400:kworker.0 00000100:00100000:3.0:1783141785.629104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141785.629107:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510521600 00000100:00100000:1.0:1783141785.629114:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510521600 00000100:00100000:1.0:1783141785.629161:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783141785.629183:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3306:x1869759510521600:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783141785.629184:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141785.629197:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510521856 00000100:00100000:3.0:1783141785.629202:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510521856 00000100:00100000:3.0:1783141785.629231:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510522112 00000100:00100000:3.0:1783141785.629234:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510522112 00000100:00100000:1.0:1783141785.629241:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3306:x1869759510521600:12345-0@lo:400:kworker.0 Request processed in 61us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141785.629254:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783141785.629254:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783141785.629265:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510521856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141785.629297:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1783141785.629305:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510521856:12345-0@lo:400:kworker.0 Request processed in 42us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141785.629307:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1783141785.629321:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783141785.629336:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141785.629342:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510522112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141785.629374:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510522112:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141785.629380:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1783141785.629394:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141785.629411:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510522368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141785.629427:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510521600:0@lo:400:kworker.0 00000100:00100000:3.0:1783141785.629440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141785.629446:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510522112:0@lo:400:kworker.0 00000100:00100000:1.0:1783141785.629637:0:6586:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783141785.629641:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510521856:0@lo:400:kworker.0 00000100:00100000:1.0:1783141785.629646:0:6586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783141785.629670:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510522368 00000100:00100000:3.0:1783141785.629674:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510522368 00000100:00100000:3.0:1783141785.629711:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783141785.629714:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510521984 00000100:00100000:3.0:1783141785.629719:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510522368:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141785.629720:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510521984 00000100:00100000:1.0:1783141785.629746:0:6586:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00002000:00000024:3.0:1783141785.629748:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141785.629757:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783141785.629766:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510521984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141785.629790:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510522368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141785.629798:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1783141785.629815:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141785.629815:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510521984:12345-0@lo:400:kworker.0 Request processed in 48us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141785.629825:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1783141785.629837:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497267480 x1869759510522368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141785.629854:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510522368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141785.630994:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510521728:12345-0@lo:400:kworker.0 Request processed in 3791us (4101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141785.631004:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783141785.631206:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510521728:0@lo:400:kworker.0 00000100:00100000:2.0:1783141785.631321:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510522240:12345-0@lo:400:kworker.0 Request processed in 3876us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141785.631331:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1783141785.631346:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464883d8a80 x1869759510522240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141785.631368:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510522240:0@lo:400:kworker.0 00010000:00080000:1.0:1783141785.632141:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496f82300 x1869759510521984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141785.632152:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510521984:0@lo:400:kworker.0 00000100:00100000:3.0:1783141785.823589:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141785.823647:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141785.823689:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141785.823734:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141785.823839:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141785.823885:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492665472 00000100:00100000:3.0:1783141785.823898:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492665472 00000100:00100000:3.0:1783141785.823967:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492665344 00000100:00100000:3.0:1783141785.823971:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492665344 00000100:00100000:3.0:1783141785.823994:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:3.0:1783141785.824005:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492665472:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141785.824104:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492665472:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 100us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141785.824113:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:3.0:1783141785.824133:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:3.0:1783141785.824140:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492665344:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141785.824165:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492665344:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141785.824171:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00080000:3.0:1783141785.824269:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141785.828593:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492665728 00000100:00100000:1.0:1783141785.828613:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492665728 00000100:00100000:1.0:1783141785.828711:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492665600 00000100:00100000:1.0:1783141785.828726:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492665600 00000100:00100000:1.0:1783141785.828773:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:1.0:1783141785.828785:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492665728:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141785.829101:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492665728:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 317us (5409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141785.829109:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:1.0:1783141785.829132:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:1.0:1783141785.829140:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492665600:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141785.829166:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492665600:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (5327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141785.829172:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:0.0:1783141785.829340:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492665216 00000100:00100000:0.0:1783141785.829346:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492665216 00000100:00100000:0.0:1783141785.829389:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 220 00000100:00100000:0.0:1783141785.829396:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492665216:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141785.829428:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492665216:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 32us (5855us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141785.829435:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 220 00000100:00080000:3.0:1783141785.830238:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141785.830246:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141786.146740:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141786.146771:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510522496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141786.146875:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141786.147182:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510522496 00000100:00100000:1.0:1783141786.147193:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510522496 00000100:00100000:1.0:1783141786.147258:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141786.147269:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510522496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141786.147322:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141786.147390:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510522496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141786.147398:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1783141786.147830:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876ebb80 x1869759510522496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141786.147868:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510522496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783141786.330820:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141787.354648:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783141787.428342:0:10181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1783141788.380924:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141789.403799:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141790.428557:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141790.746665:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510522752:0@lo:400:kworker.0 00000100:00100000:1.0:1783141790.746681:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510522880:0@lo:400:kworker.0 00000100:00100000:0.0:1783141790.746796:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510522624:0@lo:400:kworker.0 00000100:00100000:3.0:1783141790.747394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141790.747454:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510523264:0@lo:400:kworker.0 00000100:00100000:3.0:1783141790.747520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141790.747560:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510523008:0@lo:400:kworker.0 00000100:00100000:3.0:1783141790.747584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141790.747652:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510523264 00000100:00100000:3.0:1783141790.747659:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510523264 00000100:00100000:3.0:1783141790.747707:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510523008 00000100:00100000:3.0:1783141790.747710:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510523008 00000100:00100000:1.0:1783141790.747731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141790.747735:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783141790.747746:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510523264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141790.747763:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510523392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141790.747802:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510523264:12345-0@lo:400:kworker.0 Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141790.747811:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783141790.747817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141790.747842:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783141790.747850:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510523008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141790.747867:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510523392 00000100:00100000:1.0:1783141790.747872:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510523392 00000100:00100000:3.0:1783141790.747886:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869759510523008:12345-0@lo:400:kworker.0 Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141790.747894:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783141790.747903:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783141790.747911:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510523392:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783141790.747915:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141790.747920:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141790.747941:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510522752 00000100:00100000:3.0:1783141790.747946:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510522752 00002000:00000024:1.0:1783141790.747949:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141790.747975:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510522880 00000100:00100000:3.0:1783141790.747979:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510522880 00000100:00100000:1.0:1783141790.747991:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510523392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141790.747999:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783141790.748006:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783141790.748014:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510522752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141790.748055:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510522752:12345-0@lo:400:kworker.0 Request processed in 42us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141790.748062:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783141790.748074:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783141790.748079:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510522880:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1783141790.748126:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946488315880 x1869759510523392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141790.748297:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510523392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141790.748327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141790.748362:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510523136:0@lo:400:kworker.0 00000100:00100000:0.0:1783141790.748388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141790.748412:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510523136 00000100:00100000:1.0:1783141790.748417:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510523136 00000100:00100000:0.0:1783141790.748427:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510522624 00000100:00100000:0.0:1783141790.748432:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510522624 00000100:00100000:1.0:1783141790.748445:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783141790.748453:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510523136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141790.748483:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783141790.748492:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510522624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141790.748530:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510523136:12345-0@lo:400:kworker.0 Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141790.748538:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783141790.748540:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510522624:12345-0@lo:400:kworker.0 Request processed in 47us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141790.748558:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783141790.748586:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510522624:0@lo:400:kworker.0 00000100:00100000:1.0:1783141790.750363:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510523136:0@lo:400:kworker.0 00000100:00100000:3.0:1783141790.750876:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510522880:12345-0@lo:400:kworker.0 Request processed in 2793us (3144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141790.750887:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1783141790.750913:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783141790.750939:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876ebb80 x1869759510523008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141790.750951:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510523008:0@lo:400:kworker.0 00010000:00080000:3.0:1783141790.750979:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496f80a80 x1869759510523264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141790.750989:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510523264:0@lo:400:kworker.0 00000100:00100000:3.0:1783141790.751002:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510522752:0@lo:400:kworker.0 00000100:00100000:1.0:1783141790.751682:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510522880:0@lo:400:kworker.0 00000100:00100000:2.0:1783141790.944063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141790.944108:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141790.944151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141790.944174:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141790.944198:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141790.944416:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492665984 00000100:00100000:0.0:1783141790.944426:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492665984 00000100:00100000:0.0:1783141790.944501:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492666112 00000100:00100000:0.0:1783141790.944505:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492666112 00000100:00100000:0.0:1783141790.944529:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:0.0:1783141790.944538:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492665984:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141790.944695:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:1.0:1783141790.944705:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492666112:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141790.944829:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492666240 00000100:00100000:2.0:1783141790.944834:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492666240 00000100:00100000:2.0:1783141790.944864:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492666368 00000100:00100000:2.0:1783141790.944867:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492666368 00000100:00100000:2.0:1783141790.944890:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1783141790.944896:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492666240:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141790.944976:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492665856 00000100:00100000:3.0:1783141790.944981:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492665856 00000100:00100000:3.0:1783141790.945010:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 222 00000100:00100000:3.0:1783141790.945018:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492665856:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141790.945223:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492665984:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 666us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141790.945232:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00080000:0.0:1783141790.945353:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141790.945357:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783141790.945360:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141790.946047:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492666240:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 1147us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141790.946056:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1783141790.946076:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:2.0:1783141790.946085:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492666368:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141790.946117:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492666368:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 35us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141790.946124:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:0.0:1783141790.957184:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492666112:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 12469us (12996us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141790.957199:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:3.0:1783141790.964896:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492665856:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 19867us (20831us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141790.964911:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 222 00000100:00100000:2.0:1783141791.261726:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141791.261749:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510523520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141791.261827:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141791.261942:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510523520 00000100:00100000:1.0:1783141791.261950:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510523520 00000100:00100000:1.0:1783141791.262001:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783141791.262010:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510523520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141791.262058:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141791.262105:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510523520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141791.262112:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1783141791.262151:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496f82300 x1869759510523520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141791.262169:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510523520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141791.459930:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141792.475782:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141793.501192:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141794.538373:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141795.547593:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141795.866625:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510523648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141795.866693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141795.866754:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510523648 00000100:00100000:1.0:1783141795.866760:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510523648 00000100:00100000:1.0:1783141795.866814:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783141795.866823:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510523648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141795.866854:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141795.866893:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510523648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141795.866899:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1783141795.866935:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946488315f80 x1869759510523648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141795.866951:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510523648:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783141795.871251:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141795.871279:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510524160:0@lo:400:kworker.0 00000100:00100000:0.0:1783141795.871352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141795.871392:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783141795.871399:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510523776:0@lo:400:kworker.0 00000100:00100000:0.0:1783141795.871428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141795.871474:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510524288:0@lo:400:kworker.0 00000100:00100000:0.0:1783141795.871501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141795.871540:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510523904:0@lo:400:kworker.0 00000100:00100000:0.0:1783141795.871564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141795.871581:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141795.871586:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510524032:0@lo:400:kworker.0 00000100:00100000:0.0:1783141795.871607:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141795.871636:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510524160 00000100:00100000:0.0:1783141795.871642:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510524160 00000100:00100000:0.0:1783141795.871695:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510523904 00000100:00100000:0.0:1783141795.871698:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510523904 00000100:00100000:0.0:1783141795.871716:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510524032 00000100:00100000:0.0:1783141795.871719:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510524032 00000100:00100000:0.0:1783141795.871736:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783141795.871743:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510524160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141795.871806:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510524160:12345-0@lo:400:kworker.0 Request processed in 62us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141795.871818:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783141795.871835:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783141795.871841:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510523904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141795.871883:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783141795.871893:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510524032:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783141795.881977:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141795.882033:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510524160:0@lo:400:kworker.0 00000100:00100000:1.0:1783141795.882822:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510524032:12345-0@lo:400:kworker.0 Request processed in 10927us (11209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141795.882847:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783141795.882898:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510524288 00000100:00100000:1.0:1783141795.882905:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510524288 00000100:00100000:1.0:1783141795.882957:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783141795.882966:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510524288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141795.883023:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510524288:12345-0@lo:400:kworker.0 Request processed in 58us (11520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141795.883029:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783141795.883049:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510523776 00000100:00100000:1.0:1783141795.883053:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510523776 00000100:00100000:1.0:1783141795.883074:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1783141795.883080:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510523776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141795.883110:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510523776:12345-0@lo:400:kworker.0 Request processed in 30us (11681us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141795.883116:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1783141795.883263:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510524032:0@lo:400:kworker.0 00000100:00080000:3.0:1783141795.883579:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141795.883601:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510523776:0@lo:400:kworker.0 00010000:00080000:3.0:1783141795.883615:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464883d8e00 x1869759510524288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141795.883626:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510524288:0@lo:400:kworker.0 00000100:00100000:0.0:1783141795.888070:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510523904:12345-0@lo:400:kworker.0 Request processed in 16215us (16491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141795.888087:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783141795.888207:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510523904:0@lo:400:kworker.0 00000100:00100000:0.0:1783141796.064068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141796.064107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141796.064143:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141796.064173:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141796.064203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141796.064257:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492667008 00000100:00100000:3.0:1783141796.064264:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492666496 00000100:00100000:2.0:1783141796.064267:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492667008 00000100:00100000:3.0:1783141796.064271:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492666496 00000100:00100000:2.0:1783141796.064320:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492666880 00000100:00100000:3.0:1783141796.064321:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 224 00000100:00100000:2.0:1783141796.064326:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492666880 00000100:00100000:3.0:1783141796.064335:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2366:x1869759492666496:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141796.064352:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:2.0:1783141796.064361:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492667008:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141796.064404:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2366:x1869759492666496:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 72us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141796.064411:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492667008:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 49us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141796.064419:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 224 00000100:00100000:2.0:1783141796.064424:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:2.0:1783141796.064440:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:2.0:1783141796.064447:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492666880:12345-192.168.203.27@tcp:400:kworker.0 00000100:00080000:3.0:1783141796.064450:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141796.064455:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141796.064505:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492666880:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141796.064513:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:1.0:1783141796.073488:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492666752 00000100:00100000:1.0:1783141796.073789:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492666752 00000100:00100000:1.0:1783141796.073853:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492666624 00000100:00100000:1.0:1783141796.073857:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492666624 00000100:00100000:1.0:1783141796.073885:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:1.0:1783141796.073894:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492666752:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141796.074041:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492666752:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 147us (9932us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141796.074064:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:1.0:1783141796.074083:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:1.0:1783141796.074090:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492666624:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141796.074114:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492666624:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 25us (9941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141796.074120:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00080000:3.0:1783141796.074542:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141796.379717:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783141796.379740:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510524416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141796.386768:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141796.386924:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510524416 00000100:00100000:3.0:1783141796.386933:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510524416 00000100:00100000:3.0:1783141796.387021:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783141796.387034:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510524416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141796.387068:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141796.387167:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510524416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141796.387174:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1783141796.387633:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496f80a80 x1869759510524416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141796.387652:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510524416:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141796.575327:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141797.596543:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141798.622417:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141799.644609:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141800.670566:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141800.990870:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510524928:0@lo:400:kworker.0 00000100:00100000:1.0:1783141800.990932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141800.991620:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783141800.991632:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510524544:0@lo:400:kworker.0 00000100:00100000:1.0:1783141800.991672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141800.991857:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510524800:0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.991888:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141800.991919:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510525312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141800.991941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141800.991964:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783141800.991971:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510524672:0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.992003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141800.992019:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510525184:0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.992038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141800.992068:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510524800 00000100:00100000:0.0:1783141800.992075:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510524800 00000100:00100000:0.0:1783141800.992139:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510524672 00000100:00100000:0.0:1783141800.992142:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510524672 00000100:00100000:0.0:1783141800.992162:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783141800.992182:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510524800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.992233:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510524800:12345-0@lo:400:kworker.0 Request processed in 64us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141800.992240:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783141800.992256:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783141800.992262:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510524672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.992288:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510524672:12345-0@lo:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141800.992294:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783141800.992327:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510524672:0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.992337:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510524800:0@lo:400:kworker.0 00000100:00080000:3.0:1783141800.992344:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141800.992388:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510525312 00000100:00100000:0.0:1783141800.992391:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510525312 00000100:00100000:0.0:1783141800.992418:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141800.992423:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510525312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141800.992447:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141800.992533:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510525312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141800.992538:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783141800.992554:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510524928 00000100:00100000:0.0:1783141800.992557:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510524928 00000100:00100000:0.0:1783141800.992575:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510525184 00000100:00100000:0.0:1783141800.992578:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510525184 00000100:00100000:0.0:1783141800.992594:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783141800.992600:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510524928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.992624:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510524928:12345-0@lo:400:kworker.0 Request processed in 25us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141800.992629:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783141800.992638:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783141800.992643:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510525184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.992663:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510525184:12345-0@lo:400:kworker.0 Request processed in 20us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141800.992668:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1783141800.992680:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141800.992682:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783141800.992706:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497434e00 x1869759510525184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141800.992716:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510525184:0@lo:400:kworker.0 00010000:00080000:0.0:1783141800.992735:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485038e00 x1869759510525312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141800.992757:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510525312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141800.992972:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510525056:0@lo:400:kworker.0 00000100:00100000:1.0:1783141800.992997:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783141800.993022:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464876ebb80 x1869759510524928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141800.993031:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510524928:0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.993563:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510525056 00000100:00100000:0.0:1783141800.993569:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510525056 00000100:00100000:0.0:1783141800.993611:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783141800.993618:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510525056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141800.993660:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510525056:12345-0@lo:400:kworker.0 Request processed in 42us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141800.993666:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1783141800.993726:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141800.993756:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510525056:0@lo:400:kworker.0 00000100:00100000:2.0:1783141800.995767:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510524544 00000100:00100000:2.0:1783141800.995778:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510524544 00000100:00100000:2.0:1783141800.995825:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783141800.995834:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510524544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141800.995913:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510524544:12345-0@lo:400:kworker.0 Request processed in 79us (4240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141800.995920:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1783141800.996126:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510524544:0@lo:400:kworker.0 00000100:00100000:0.0:1783141801.187622:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141801.187673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141801.187692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141801.187715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141801.187737:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141801.187777:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492667264 00000100:00100000:0.0:1783141801.187786:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492667264 00000100:00100000:0.0:1783141801.187847:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492667392 00000100:00100000:0.0:1783141801.187850:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492667392 00000100:00100000:0.0:1783141801.187876:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:0.0:1783141801.187886:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492667264:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141801.187962:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492667264:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 77us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141801.187970:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:0.0:1783141801.187987:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:0.0:1783141801.187993:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2368:x1869759492667392:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141801.188026:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2368:x1869759492667392:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 33us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141801.188032:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:0.0:1783141801.188054:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492667520 00000100:00100000:0.0:1783141801.188058:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492667520 00000100:00100000:0.0:1783141801.188080:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492667648 00000100:00100000:0.0:1783141801.188083:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492667648 00000100:00100000:0.0:1783141801.188101:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:0.0:1783141801.188107:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464969d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2365:x1869759492667520:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:0.0:1783141801.188124:0:10144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898766 00000100:00080000:0.0:1783141801.188132:0:10144:0:(import.c:65:import_set_state_nolock()) ffff94649d12e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141801.188169:0:10144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783141801.188453:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464969d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+2:2365:x1869759492667520:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 345us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141801.188489:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:0.0:1783141801.188628:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:0.0:1783141801.188635:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2365:x1869759492667648:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:0.0:1783141801.188648:0:10144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da89876d 00000100:00080000:0.0:1783141801.188653:0:10144:0:(import.c:65:import_set_state_nolock()) ffff94649d129000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141801.188674:0:10144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783141801.188958:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492667136 00000100:00100000:1.0:1783141801.188963:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492667136 00000100:00100000:1.0:1783141801.189000:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 226 00000100:00100000:1.0:1783141801.189007:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492667136:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141801.189045:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492667136:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 39us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141801.189052:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 226 00000100:00080000:1.0:1783141801.189075:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783141801.189080:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141801.189082:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141801.191454:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+2:2365:x1869759492667648:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 2812us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141801.193921:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00010000:00010000:0.0:1783141801.193992:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141801.193998:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141801.498809:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510525440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141801.498891:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141801.499017:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510525440 00000100:00100000:3.0:1783141801.499026:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510525440 00000100:00100000:3.0:1783141801.499130:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783141801.499141:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510525440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141801.499175:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1783141801.521758:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497437480 x1869759510525440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141801.521786:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510525440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141801.521832:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510525440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 22678us (22926us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141801.521844:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1783141801.692036:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783141802.057769:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20702fa5-92e9-446c-b215-c14c139e5a0c 00000020:00000080:3.0:1783141802.057777:0:6610:0:(genops.c:906:class_export_put()) final put ffff94649d12c800/20702fa5-92e9-446c-b215-c14c139e5a0c 00000020:00000080:2.0:1783141802.057896:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff94649d12c800/20702fa5-92e9-446c-b215-c14c139e5a0c for lustre-OST0000 00000020:00000080:2.0:1783141802.057953:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94649d12e000 for lustre-OST0000 00010000:00010000:0.0:1783141802.714688:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141803.740265:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783141804.613474:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20702fa5-92e9-446c-b215-c14c139e5a0c 00000020:00000080:0.0:1783141804.613482:0:7506:0:(genops.c:906:class_export_put()) final put ffff94649d12e800/20702fa5-92e9-446c-b215-c14c139e5a0c 00000020:00000080:3.0:1783141804.613563:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94649d12e800/20702fa5-92e9-446c-b215-c14c139e5a0c for lustre-OST0001 00000020:00000080:3.0:1783141804.613631:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94649d129000 for lustre-OST0001 00010000:00010000:0.0:1783141804.768815:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783141805.403660:0:10885:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783141805.786709:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141806.109036:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141806.109092:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510525568:0@lo:400:kworker.0 00000100:00100000:3.0:1783141806.109162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141806.109228:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510525568 00000100:00100000:3.0:1783141806.109235:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510525568 00000100:00100000:3.0:1783141806.109285:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783141806.109295:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510525568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141806.109349:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510525568:12345-0@lo:400:kworker.0 Request processed in 55us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141806.109358:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783141806.109382:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510525696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141806.109399:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510525952:0@lo:400:kworker.0 00000100:00100000:1.0:1783141806.109449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141806.109455:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141806.109507:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510526208:0@lo:400:kworker.0 00000100:00100000:3.0:1783141806.109518:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510525568:0@lo:400:kworker.0 00000100:00100000:1.0:1783141806.109532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141806.109554:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141806.109562:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510526080:0@lo:400:kworker.0 00000100:00100000:1.0:1783141806.109576:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783141806.109587:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510525824:0@lo:400:kworker.0 00000100:00100000:3.0:1783141806.109593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141806.109622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141806.109649:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510525952 00000100:00100000:3.0:1783141806.109653:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510525952 00000100:00100000:1.0:1783141806.109656:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510526336:0@lo:400:kworker.0 00000100:00100000:1.0:1783141806.109684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141806.109697:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510526208 00000100:00100000:3.0:1783141806.109701:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510526208 00000100:00100000:1.0:1783141806.109731:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510525824 00000100:00100000:1.0:1783141806.109736:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510525824 00000100:00100000:3.0:1783141806.109743:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783141806.109752:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510525952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141806.109765:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783141806.109775:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510526208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141806.109795:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510525952:12345-0@lo:400:kworker.0 Request processed in 43us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141806.109802:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783141806.109819:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783141806.109825:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510526208:12345-0@lo:400:kworker.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141806.109830:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510525824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141806.109839:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783141806.109868:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510525824:12345-0@lo:400:kworker.0 Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141806.109875:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1783141806.109876:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141806.109892:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510526080 00000100:00100000:1.0:1783141806.109897:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510526080 00000100:00100000:3.0:1783141806.109902:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510526336 00000100:00100000:3.0:1783141806.109907:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510526336 00000100:00100000:1.0:1783141806.109936:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783141806.109952:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510526080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141806.109990:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510526080:12345-0@lo:400:kworker.0 Request processed in 39us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141806.109996:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783141806.110012:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783141806.110019:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510526336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141806.110026:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510525824:0@lo:400:kworker.0 00000100:00100000:0.0:1783141806.110044:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510526208:0@lo:400:kworker.0 00000100:00100000:1.0:1783141806.110059:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510526336:12345-0@lo:400:kworker.0 Request processed in 40us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141806.110066:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1783141806.110072:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648503a680 x1869759510526336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141806.110083:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510526336:0@lo:400:kworker.0 00000100:00080000:0.0:1783141806.110105:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141806.110108:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783141806.110170:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485039180 x1869759510526080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141806.110179:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510526080:0@lo:400:kworker.0 00000100:00100000:3.0:1783141806.110187:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510525952:0@lo:400:kworker.0 00000100:00100000:2.0:1783141806.110455:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510525696 00000100:00100000:2.0:1783141806.110481:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510525696 00000100:00100000:2.0:1783141806.110522:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783141806.110530:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510525696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141806.110573:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141806.110630:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510525696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141806.110637:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1783141806.110886:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94648503a300 x1869759510525696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141806.110901:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510525696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141806.302778:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141806.303518:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141806.303554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141806.303623:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492668032 00000100:00100000:2.0:1783141806.303633:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492668032 00000100:00100000:2.0:1783141806.303696:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492667904 00000100:00100000:2.0:1783141806.303699:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492667904 00000100:00100000:2.0:1783141806.303729:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:2.0:1783141806.303746:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2368:x1869759492668032:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141806.303814:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2368:x1869759492668032:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141806.303822:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:2.0:1783141806.303837:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:2.0:1783141806.303856:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492667904:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141806.303883:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492667904:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141806.303889:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00080000:1.0:1783141806.304186:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141806.314172:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492667776 00000100:00100000:3.0:1783141806.314186:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492667776 00000100:00100000:1.0:1783141806.316974:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 228 00000100:00100000:1.0:1783141806.317000:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492667776:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141806.317096:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492667776:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 107us (14325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141806.317103:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 228 00000100:00100000:0.0:1783141806.624863:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510526464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141806.624968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141806.626378:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510526464 00000100:00100000:1.0:1783141806.626395:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510526464 00000100:00100000:1.0:1783141806.626530:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783141806.626554:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510526464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141806.626889:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141806.627124:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510526464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 515us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141806.627137:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1783141806.632674:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497434000 x1869759510526464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141806.632865:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510526464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783141806.811726:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141807.835611:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141808.858626:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783141809.549855:0:11032:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0e49b2a0 20000000:00000080:3.0:1783141809.549872:0:11032:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9464973ea800 uarg=0000000000000000 20000000:01000000:3.0:1783141809.549910:0:11032:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783141809.549917:0:11032:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783141809.549921:0:11032:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1783141809.552454:0:11033:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1783141809.552961:0:11032:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783141809.560893:0:11032:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783141809.560985:0:11032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561006:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf8 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561015:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898720 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561023:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89872e expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561029:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89873c expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561036:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd30 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561043:0:11032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561082:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd30 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561095:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd30 expref: 12 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.561109:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497437100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510526592:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141809.561240:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da89873c expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561276:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da89873c expref: 18 pid: 5782 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.561286:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510526720:0@lo:104: 00000100:00100000:1.0:1783141809.561322:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783141809.561359:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da89872e expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561367:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da89872e expref: 18 pid: 5779 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.561375:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497437800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510526848:0@lo:104: 00000100:00100000:1.0:1783141809.561392:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783141809.561412:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898720 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561420:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898720 expref: 18 pid: 5780 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.561428:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497435880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510526976:0@lo:104: 00000100:00100000:1.0:1783141809.561442:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783141809.561454:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf8 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.561482:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf8 expref: 12 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.561490:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510527104:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141809.561517:0:11032:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141809.561582:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510526720 00000100:00100000:2.0:1783141809.561598:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510526720 00000100:00100000:2.0:1783141809.561630:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510526848 00000100:00100000:2.0:1783141809.561632:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510526848 00000100:00100000:2.0:1783141809.561640:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510526976 00000100:00100000:2.0:1783141809.561642:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510526976 00000100:00100000:2.0:1783141809.561653:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783141809.561660:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+5:11032:x1869759510526720:12345-0@lo:104: 00010000:00010000:2.0:1783141809.561672:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.561739:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783141809.561745:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+5:11032:x1869759510526720:12345-0@lo:104: Request processed in 86us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.561751:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783141809.561765:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783141809.561770:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+4:11032:x1869759510526848:12345-0@lo:104: 00010000:00010000:2.0:1783141809.561777:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.561804:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783141809.561808:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+4:11032:x1869759510526848:12345-0@lo:104: Request processed in 38us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.561822:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783141809.561832:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783141809.561837:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:11032:x1869759510526976:12345-0@lo:104: 00010000:00010000:2.0:1783141809.561844:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.561870:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783141809.561875:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:872ec41a-f648-467b-b036-39669ac398c4+3:11032:x1869759510526976:12345-0@lo:104: Request processed in 38us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.561880:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1783141809.561892:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783141809.561898:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.561905:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141809.561909:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.561917:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141809.561924:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141809.561929:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141809.561951:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.561957:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141809.561980:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.561987:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89873c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898743 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.561999:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783141809.562002:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562007:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53400 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141809.562010:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562017:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141809.562022:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141809.562027:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141809.562036:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562041:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141809.562053:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562059:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da89872e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898735 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562066:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141809.562072:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562078:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53600 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141809.562081:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562087:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141809.562093:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141809.562097:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783141809.562107:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562112:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141809.562117:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562123:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946496f53600/0x279ffa91da898720 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898727 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562133:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141809.562135:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141809.562136:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141809.562141:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141809.562146:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141809.562154:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510527232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141809.562183:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141809.562222:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510527360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141809.562241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141809.562254:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141809.562259:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510527488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141809.562273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141809.562294:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510527232 00000100:00100000:2.0:1783141809.562298:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510527232 00010000:00010000:2.0:1783141809.562313:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89873c expref: 19 pid: 5782 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141809.562329:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510527360 00000100:00100000:2.0:1783141809.562331:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510527360 00010000:00010000:2.0:1783141809.562338:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89872e expref: 20 pid: 5779 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141809.562350:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510527488 00000100:00100000:2.0:1783141809.562352:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510527488 00010000:00010000:2.0:1783141809.562360:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898720 expref: 21 pid: 5780 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141809.562371:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783141809.562376:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946493c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+21:3308:x1869759510527232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141809.562385:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141809.562389:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89873c expref: 21 pid: 5782 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562397:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da89873c expref: 21 pid: 5782 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562411:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141809.562439:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946493c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+21:3308:x1869759510527232:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.562444:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783141809.562498:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783141809.562503:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+20:3305:x1869759510527360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141809.562509:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141809.562514:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89872e expref: 20 pid: 5779 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562522:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da89872e expref: 20 pid: 5779 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562530:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141809.562550:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+20:3305:x1869759510527360:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.562555:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783141809.562564:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783141809.562569:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510527488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141809.562575:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141809.562578:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898720 expref: 19 pid: 5780 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562586:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898720 expref: 19 pid: 5780 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.562594:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141809.562608:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510527488:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141809.562613:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783141809.562654:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510527488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141809.562661:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510527360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141809.562678:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510527232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783141809.563268:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946496f53000/0x279ffa91da898743 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da89873c expref: 18 pid: 5782 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.563284:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510526720:0@lo:104: 00010000:00010000:1.0:1783141809.563294:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94649d0d7e00/0x279ffa91da898735 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da89872e expref: 17 pid: 5779 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.563303:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497437800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510526848:0@lo:104: 00010000:00010000:1.0:1783141809.563310:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a1c00/0x279ffa91da898727 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898720 expref: 16 pid: 5780 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.563318:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497435880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510526976:0@lo:104: 00000100:00100000:2.0:1783141809.570433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141809.570579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141809.570750:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492668160 00000100:00100000:0.0:1783141809.570761:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492668160 00010000:00010000:0.0:1783141809.570800:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd30 expref: 13 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141809.570837:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492668288 00000100:00100000:0.0:1783141809.570851:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492668288 00010000:00010000:0.0:1783141809.570866:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf8 expref: 14 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141809.570893:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:0.0:1783141809.570903:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+14:2369:x1869759492668160:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141809.570917:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141809.570922:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd30 expref: 14 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.570934:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd30 expref: 14 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.570953:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141809.570999:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+14:2369:x1869759492668160:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 98us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141809.571007:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:0.0:1783141809.571023:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:0.0:1783141809.571030:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492668288:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141809.571037:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141809.571041:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf8 expref: 13 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571051:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf8 expref: 13 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571063:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571082:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571098:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571106:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571112:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571118:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571124:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141809.571128:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571136:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571144:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141809.571154:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141809.571174:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492668288:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 144us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141809.571181:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00010000:00010000:1.0:1783141809.571482:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94649d0d6800/0x279ffa91da898758 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd30 expref: 12 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.571496:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497437100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510526592:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141809.571509:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94649d0d6e00/0x279ffa91da898719 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf8 expref: 11 pid: 5782 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141809.571517:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1869759510527104:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141809.571547:0:11032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.571557:0:11032:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.571564:0:11032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141809.571578:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946496f52200/0x279ffa91da898774 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141809.885431:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141810.778430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141810.784306:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492668416 00000100:00100000:0.0:1783141810.784329:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492668416 00000100:00100000:0.0:1783141810.784735:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 229 00000100:00100000:0.0:1783141810.784747:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:5580:x1869759492668416:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141810.784773:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141810.784791:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd5a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141810.784818:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd5a expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141810.784828:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd5a expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141810.784836:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7a00, rc 0) 00000100:00100000:0.0:1783141810.784902:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492668416:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 157us (6481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141810.784911:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 229 00000100:00100000:0.0:1783141810.800056:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141810.803576:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492668544 00000100:00100000:2.0:1783141810.803600:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492668544 00000100:00100000:2.0:1783141810.803651:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 230 00000100:00100000:2.0:1783141810.803660:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492668544:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141810.803951:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492668544:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 291us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141810.803959:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 230 00000100:00100000:3.0:1783141810.816961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141810.816996:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492668672 00000100:00100000:3.0:1783141810.817004:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492668672 00000100:00100000:3.0:1783141810.817047:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 231 00000100:00100000:3.0:1783141810.817057:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492668672:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141810.817260:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492668672:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 204us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141810.817268:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 231 00000100:00100000:2.0:1783141810.829926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141810.830222:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492668800 00000100:00100000:3.0:1783141810.830232:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492668800 00000100:00100000:3.0:1783141810.830286:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:3.0:1783141810.830296:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492668800:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141810.830312:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141810.830331:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd61 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141810.830357:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd61 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141810.830369:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd61 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141810.830391:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174600, rc 0) 00000100:00100000:3.0:1783141810.830444:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492668800:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 150us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141810.830452:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:1.0:1783141810.856579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141810.858310:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492668928 00000100:00100000:0.0:1783141810.858323:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492668928 00000100:00100000:0.0:1783141810.858386:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 233 00000100:00100000:0.0:1783141810.858397:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492668928:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141810.858746:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492668928:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 349us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141810.861430:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 233 00000100:00100000:0.0:1783141810.869862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141810.873838:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492669056 00000100:00100000:2.0:1783141810.873853:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492669056 00000100:00100000:2.0:1783141810.873907:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 234 00000100:00100000:2.0:1783141810.873918:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492669056:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141810.874149:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492669056:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 232us (4294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141810.874158:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 234 00010000:00010000:2.0:1783141810.909551:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141811.227868:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510527744:0@lo:400:kworker.0 00000100:00100000:3.0:1783141811.227973:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141811.228024:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510528256:0@lo:400:kworker.0 00000100:00100000:3.0:1783141811.228053:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141811.228081:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783141811.228087:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510527616:0@lo:400:kworker.0 00000100:00100000:3.0:1783141811.228115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141811.228136:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510528128:0@lo:400:kworker.0 00000100:00100000:3.0:1783141811.228159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141811.228184:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510527872:0@lo:400:kworker.0 00000100:00100000:3.0:1783141811.228207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141811.228224:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141811.228229:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510528000:0@lo:400:kworker.0 00000100:00100000:3.0:1783141811.228251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141811.228281:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510527744 00000100:00100000:3.0:1783141811.228289:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510527744 00000100:00100000:3.0:1783141811.228332:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510528128 00000100:00100000:3.0:1783141811.228336:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510528128 00000100:00100000:3.0:1783141811.228360:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510527872 00000100:00100000:3.0:1783141811.228363:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510527872 00000100:00100000:3.0:1783141811.228381:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783141811.228402:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510527744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141811.228453:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510527744:12345-0@lo:400:kworker.0 Request processed in 53us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141811.228489:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783141811.228505:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783141811.228512:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510528128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141811.228540:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510528128:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141811.228546:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783141811.228556:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783141811.228561:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510527872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141811.228984:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510527872:12345-0@lo:400:kworker.0 Request processed in 421us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141811.228992:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783141811.229012:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510528256 00000100:00100000:3.0:1783141811.229016:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510528256 00000100:00100000:3.0:1783141811.229603:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510528000 00000100:00100000:3.0:1783141811.229610:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510528000 00000100:00100000:1.0:1783141811.233367:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783141811.233392:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510528256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141811.233504:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510528256:12345-0@lo:400:kworker.0 Request processed in 124us (5450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141811.233512:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783141811.233536:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783141811.233543:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510528000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141811.233574:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510528000:12345-0@lo:400:kworker.0 Request processed in 32us (5323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141811.233589:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783141811.233736:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510527616 00000100:00100000:2.0:1783141811.233745:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510527616 00000100:00100000:2.0:1783141811.233797:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783141811.233814:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:3308:x1869759510527616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141811.233849:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+16:3308:x1869759510527616:12345-0@lo:400:kworker.0 Request processed in 37us (5733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141811.233855:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1783141811.235019:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510527616:0@lo:400:kworker.0 00000100:00100000:1.0:1783141811.235039:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510528128:0@lo:400:kworker.0 00000100:00100000:1.0:1783141811.235050:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510527744:0@lo:400:kworker.0 00010000:00080000:1.0:1783141811.235062:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946488316680 x1869759510528256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141811.235074:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510528256:0@lo:400:kworker.0 00000100:00080000:2.0:1783141811.235242:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141811.235248:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141811.235251:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141811.236565:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510528384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141811.236638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783141811.236701:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946488315180 x1869759510528000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141811.236714:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510528000:0@lo:400:kworker.0 00000100:00100000:2.0:1783141811.236736:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510527872:0@lo:400:kworker.0 00000100:00100000:1.0:1783141811.236993:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510528384 00000100:00100000:1.0:1783141811.237000:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510528384 00000100:00100000:1.0:1783141811.237058:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783141811.237067:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510528384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141811.237102:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141811.237150:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510528384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141811.237157:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1783141811.237185:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485038380 x1869759510528384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141811.237200:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510528384:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1783141811.355955:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141811.355963:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946381363000 from 7 10000000:01000000:1.0:1783141811.355968:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141811.356015:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141811.356027:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141811.356038:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141811.356062:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510528512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141811.356128:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141811.356180:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312a540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141811.356281:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510528512 00000100:00100000:2.0:1783141811.356289:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510528512 00000100:00100000:2.0:1783141811.356333:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783141811.356342:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510528512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141811.356356:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141811.356367:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898789 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141811.356391:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898789 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141811.356402:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898789 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141811.356428:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0800, rc 0) 00000100:00100000:2.0:1783141811.356478:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510528512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141811.356485:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783141811.356621:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510528512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141811.356637:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141811.356657:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141811.356716:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510528640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141811.356742:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141811.356777:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312a540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141811.357001:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510528640 00000100:00100000:2.0:1783141811.357006:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510528640 00000100:00100000:2.0:1783141811.357039:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783141811.357046:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510528640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141811.357277:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510528640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141811.357284:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783141811.357706:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510528640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141811.357760:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510528768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141811.357804:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141811.357836:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648312a540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141811.357936:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510528768 00000100:00100000:0.0:1783141811.357948:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510528768 00000100:00100000:0.0:1783141811.357983:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783141811.357991:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510528768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141811.358144:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510528768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141811.358151:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783141811.360630:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510528768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783141811.362192:0:11090:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783141811.368694:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783141811.368872:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783141811.368884:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141811.368896:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141811.380563:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783141811.380572:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff94649d28d000 from 7 10000000:01000000:0.0:1783141811.380586:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141811.380632:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141811.380643:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141811.380653:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141811.380687:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510528896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141811.380863:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141811.380909:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981b180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141811.381453:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510528896 00000100:00100000:3.0:1783141811.381483:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510528896 00000100:00100000:3.0:1783141811.381528:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783141811.381537:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510528896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141811.381550:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141811.381563:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da898797 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141811.381598:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da898797 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141811.381622:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898797 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141811.381631:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174a00, rc 0) 00000100:00100000:3.0:1783141811.381692:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510528896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141811.381699:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1783141811.382364:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510528896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141811.382381:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141811.382390:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141811.382497:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141811.382530:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141811.382554:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649685d900 going to sleep for 11 seconds 00000100:00100000:0.0:1783141811.382603:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510529024 00000100:00100000:0.0:1783141811.382608:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510529024 00000100:00100000:0.0:1783141811.382639:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783141811.382646:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510529024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141811.382895:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510529024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141811.382901:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1783141811.383022:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141811.383051:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141811.383085:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141811.383105:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649685d900 going to sleep for 11 seconds 00000100:00100000:0.0:1783141811.383303:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510529152 00000100:00100000:0.0:1783141811.383314:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510529152 00000100:00100000:0.0:1783141811.383343:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783141811.383349:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510529152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141811.383494:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510529152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141811.383500:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783141811.383532:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783141811.384830:0:11091:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783141811.384980:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783141811.385002:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783141811.385012:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141811.385022:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141811.385032:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783141811.385035:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946489ce7800 from 7 10000000:01000000:0.0:1783141811.385037:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141811.385067:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141811.385075:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141811.385084:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141811.385103:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141811.385217:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141811.385313:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141811.389571:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510529280 00000100:00100000:2.0:1783141811.389585:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510529280 00000100:00100000:0.0:1783141811.389706:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783141811.389864:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510529280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141811.389883:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141811.389902:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8987a5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141811.389930:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8987a5 expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141811.389941:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8987a5 expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141811.389950:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7e00, rc 0) 00000100:00100000:0.0:1783141811.390063:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510529280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 347us (4845us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141811.390071:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783141811.390207:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141811.390225:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141811.390235:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141811.390298:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141811.390331:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141811.390399:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649685dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141811.390573:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510529408 00000100:00100000:3.0:1783141811.390647:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510529408 00000100:00100000:2.0:1783141811.390919:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783141811.390928:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510529408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141811.391284:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510529408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141811.391291:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783141811.391373:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141811.391408:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141811.391480:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141811.391547:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a34600 going to sleep for 11 seconds 00000100:00100000:2.0:1783141811.391710:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510529536 00000100:00100000:2.0:1783141811.391715:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510529536 00000100:00100000:2.0:1783141811.391891:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1783141811.391900:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510529536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141811.392041:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510529536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141811.392047:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783141811.392115:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510529536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783141811.393051:0:11092:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783141811.393113:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783141811.393248:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783141811.393259:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141811.393269:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141811.418851:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141811.418881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141811.418923:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492669184 00000100:00100000:3.0:1783141811.418932:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492669184 00000100:00100000:3.0:1783141811.418985:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492669312 00000100:00100000:3.0:1783141811.418989:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492669312 00000100:00100000:3.0:1783141811.419009:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 89 00000100:00100000:3.0:1783141811.419018:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492669184:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141811.419091:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492669184:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 73us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141811.419098:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 89 00000100:00100000:3.0:1783141811.419114:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 90 00000100:00100000:3.0:1783141811.419120:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492669312:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141811.419491:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492669312:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 370us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141811.419499:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 90 00000100:00080000:3.0:1783141811.419516:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141811.741338:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141811.741360:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510529664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141811.741422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141811.741502:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510529664 00000100:00100000:1.0:1783141811.741510:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510529664 00000100:00100000:1.0:1783141811.741552:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783141811.741561:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510529664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141811.741605:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141811.741647:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510529664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141811.741653:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1783141811.741703:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497434000 x1869759510529664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141811.741726:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510529664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141811.931068:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141812.954837:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141813.978794:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783141814.408724:0:11231:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783141815.004290:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141816.032211:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141816.346689:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510529792:0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.346752:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510529920:0@lo:400:kworker.0 00000100:00100000:2.0:1783141816.346761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141816.351518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141816.351596:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510530432:0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.351650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141816.351706:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510530048:0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.351729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141816.351749:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464883d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510530560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141816.351770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141816.351787:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141816.351794:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510530176:0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.351813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141816.351838:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510530432 00000100:00100000:1.0:1783141816.351845:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510530432 00000100:00100000:1.0:1783141816.351890:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510530176 00000100:00100000:1.0:1783141816.351893:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510530176 00000100:00100000:1.0:1783141816.351914:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783141816.351921:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510530432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.351972:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510530432:12345-0@lo:400:kworker.0 Request processed in 51us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141816.351979:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783141816.351994:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783141816.352000:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510530176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.352047:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510530176:12345-0@lo:400:kworker.0 Request processed in 47us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141816.352053:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783141816.352069:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510529920 00000100:00100000:1.0:1783141816.352072:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510529920 00000100:00100000:1.0:1783141816.352090:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510530048 00000100:00100000:1.0:1783141816.352092:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510530048 00000100:00100000:1.0:1783141816.352106:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783141816.352112:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510529920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.352137:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510529920:12345-0@lo:400:kworker.0 Request processed in 25us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141816.352142:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783141816.352151:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783141816.352156:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510530048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.352175:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510530048:12345-0@lo:400:kworker.0 Request processed in 20us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141816.352180:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1783141816.352191:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141816.352195:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141816.352197:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783141816.352222:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946488315500 x1869759510530176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141816.352235:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510530176:0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.352247:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510530048:0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.352280:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510529920:0@lo:400:kworker.0 00010000:00080000:1.0:1783141816.352298:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946488317800 x1869759510530432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141816.352307:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510530432:0@lo:400:kworker.0 00000100:00100000:0.0:1783141816.353316:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510530560 00000100:00100000:0.0:1783141816.353324:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510530560 00000100:00100000:0.0:1783141816.353367:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783141816.353374:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510530560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141816.353403:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1783141816.353494:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464883d8e00 x1869759510530560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141816.353508:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464883d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510530560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141816.353576:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510530560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141816.353583:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783141816.353599:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510529792 00000100:00100000:0.0:1783141816.353603:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510529792 00000100:00100000:0.0:1783141816.353630:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783141816.353635:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510529792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141816.353678:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510529792:12345-0@lo:400:kworker.0 Request processed in 43us (6920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141816.353683:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1783141816.357305:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510529792:0@lo:400:kworker.0 00000100:00100000:2.0:1783141816.357323:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510530304:0@lo:400:kworker.0 00000100:00100000:2.0:1783141816.357454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141816.357536:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510530304 00000100:00100000:1.0:1783141816.357543:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510530304 00000100:00100000:1.0:1783141816.357604:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783141816.357614:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510530304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141816.357677:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510530304:12345-0@lo:400:kworker.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141816.357684:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783141816.358024:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510530304:0@lo:400:kworker.0 00000100:00080000:3.0:1783141816.358771:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141816.548395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141816.548433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141816.548481:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141816.548899:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492669440 00000100:00100000:0.0:1783141816.548908:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492669440 00000100:00100000:0.0:1783141816.548970:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:0.0:1783141816.548980:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492669440:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141816.549056:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492669440:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 77us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141816.549064:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:1.0:1783141816.549745:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492669696 00000100:00100000:1.0:1783141816.549751:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492669696 00000100:00100000:1.0:1783141816.549798:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492669568 00000100:00100000:1.0:1783141816.549801:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492669568 00000100:00100000:1.0:1783141816.549832:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00100000:1.0:1783141816.549840:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492669696:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141816.549887:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492669696:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 49us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141816.549893:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00100000:1.0:1783141816.549906:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 95 00000100:00100000:1.0:1783141816.549913:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492669568:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141816.549965:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492669568:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 42us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141816.549972:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 95 00000100:00080000:3.0:1783141816.550437:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141816.858736:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141816.858759:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510530688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141816.858827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141816.859118:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510530688 00000100:00100000:1.0:1783141816.859127:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510530688 00000100:00100000:1.0:1783141816.859182:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783141816.859192:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510530688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141816.859228:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141816.859281:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510530688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141816.859297:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1783141816.859384:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497437b80 x1869759510530688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141816.859400:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510530688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783141817.050648:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783141817.566939:0:11331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:10:15 (1783141815) === 00000100:00100000:2.0:1783141817.899892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141817.900003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141817.900152:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492669952 00000100:00100000:0.0:1783141817.900161:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492669952 00000100:00100000:0.0:1783141817.900216:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:0.0:1783141817.900226:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:9655:x1869759492669952:12345-192.168.203.27@tcp:700:mkdir.0 00000100:00100000:0.0:1783141817.900308:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:9655:x1869759492669952:12345-192.168.203.27@tcp:700:mkdir.0 Request processed in 83us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141817.900316:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:1.0:1783141817.900990:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492669824 00000100:00100000:1.0:1783141817.900996:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492669824 00000100:00100000:1.0:1783141817.901073:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:1.0:1783141817.901082:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492669824:12345-192.168.203.27@tcp:41:mkdir.0 00000004:00000024:1.0:1783141817.901114:0:5786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783141817.901177:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492669824:12345-192.168.203.27@tcp:41:mkdir.0 Request processed in 95us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141817.901183:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:2.0:1783141817.907846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141817.907930:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492670208 00000100:00100000:1.0:1783141817.907940:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492670208 00000100:00100000:1.0:1783141817.907995:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:1.0:1783141817.908005:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:9655:x1869759492670208:12345-192.168.203.27@tcp:36:mkdir.0 00010000:00010000:1.0:1783141817.908065:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141817.908138:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da898694 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fce3 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.908176:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:1.0:1783141817.908188:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141817.908751:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.908765:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.908775:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.908787:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.908793:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.908799:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141817.910023:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783141817.910039:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.910048:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.910055:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.910061:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141817.910072:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.910080:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.910094:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648becab00) 00010000:00010000:1.0:1783141817.910097:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141817.910101:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.910108:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8987b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141817.910125:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057dabc3c reply state 000000003c30f553 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141817.910134:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141817.910913:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:9655:x1869759492670208:12345-192.168.203.27@tcp:36:mkdir.0 Request processed in 2905us (3071us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783141817.910923:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00010000:00010000:1.0:1783141817.916887:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.916903:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.916910:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.916916:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141817.916920:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.916941:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.916959:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94648beca100) 00010000:00010000:1.0:1783141817.916962:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141817.916967:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.916973:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987ba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141817.931309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141817.931404:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492670336 00000100:00100000:0.0:1783141817.931423:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492670336 00000100:00100000:0.0:1783141817.931510:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:0.0:1783141817.931520:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:9657:x1869759492670336:12345-192.168.203.27@tcp:101:chmod.0 00010000:00010000:0.0:1783141817.931544:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141817.931567:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da8987c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd68 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.931654:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da8987c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.931668:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da8987c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.931680:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da8987c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141817.931745:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783141817.931750:0:10143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141817.931789:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da8987c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.931815:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da8987c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd68 expref: 8 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.931831:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da8987c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd68 expref: 7 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.931839:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ad400) 00010000:00010000:0.0:1783141817.931842:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141817.931845:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7400, rc 0) 00000100:00100000:0.0:1783141817.931898:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:9657:x1869759492670336:12345-192.168.203.27@tcp:101:chmod.0 Request processed in 378us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141817.931905:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:3.0:1783141817.935136:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141817.935772:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492670592 00000100:00100000:1.0:1783141817.935783:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492670592 00000100:00100000:1.0:1783141817.935848:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:1.0:1783141817.935858:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:9657:x1869759492670592:12345-192.168.203.27@tcp:36:chmod.0 00010000:00010000:1.0:1783141817.935912:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141817.935938:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da8987c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd68 expref: 7 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.935958:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ad400) 00010000:00010000:1.0:1783141817.935968:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141817.935993:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.936006:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141817.936017:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141817.936301:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000229df64 reply state 000000009e457b63 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141817.936311:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783141817.936322:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1783141817.936411:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:9657:x1869759492670592:12345-192.168.203.27@tcp:36:chmod.0 Request processed in 554us (1283us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783141817.936419:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00010000:00010000:0.0:1783141817.938639:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.938670:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.938678:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.938684:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141817.938688:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.938696:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.938712:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648beca100) 00010000:00010000:0.0:1783141817.938715:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783141817.938719:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141817.938725:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8987cf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141817.966695:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141817.972394:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492670720 00000100:00100000:1.0:1783141817.972408:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492670720 00000100:00100000:2.0:1783141817.973723:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:2.0:1783141817.973735:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:9658:x1869759492670720:12345-192.168.203.27@tcp:101:chown.0 00010000:00010000:2.0:1783141817.973759:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141817.973783:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8987d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd6f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.973846:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8987dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.973859:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8987dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.973871:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8987dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141817.973947:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783141817.973951:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141817.973988:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8987dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.974012:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8987d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd6f expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.974030:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8987dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd6f expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.974052:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722e00) 00010000:00010000:2.0:1783141817.974055:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141817.974059:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1c00, rc 0) 00000100:00100000:2.0:1783141817.974126:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:9658:x1869759492670720:12345-192.168.203.27@tcp:101:chown.0 Request processed in 393us (7440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141817.974133:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:3.0:1783141817.977343:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141817.977514:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492670848 00000100:00100000:2.0:1783141817.977524:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492670848 00000100:00100000:2.0:1783141817.977677:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:2.0:1783141817.977688:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:9658:x1869759492670848:12345-192.168.203.27@tcp:101:chown.0 00010000:00010000:2.0:1783141817.977709:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141817.977729:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8987e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd76 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.977797:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.977812:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.977823:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.977838:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.977845:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.977870:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.977991:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8987f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.977998:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8987f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978005:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8987f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141817.978649:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783141817.978654:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141817.978685:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8987f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978699:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978706:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978713:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978719:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141817.978723:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978731:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978753:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722e00) 00010000:00010000:2.0:1783141817.978756:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141817.978760:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978767:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8987eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978781:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978787:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978793:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978799:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141817.978802:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978808:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978816:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94648c722b00) 00010000:00010000:2.0:1783141817.978818:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141817.978821:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978826:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8987f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978869:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8987e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd76 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978882:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8987f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd76 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.978888:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648c722f00) 00010000:00010000:2.0:1783141817.978901:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141817.978904:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0200, rc 0) 00000100:00100000:2.0:1783141817.979050:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:9658:x1869759492670848:12345-192.168.203.27@tcp:101:chown.0 Request processed in 1363us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141817.979058:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:3.0:1783141817.987294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141817.987848:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492671104 00000100:00100000:2.0:1783141817.987857:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492671104 00000100:00100000:2.0:1783141817.987903:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:2.0:1783141817.987912:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:9658:x1869759492671104:12345-192.168.203.27@tcp:36:chown.0 00010000:00010000:2.0:1783141817.987961:0:7171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141817.987992:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8987f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd76 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.988011:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648c722f00) 00010000:00010000:2.0:1783141817.988021:0:7171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141817.988044:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.988057:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141817.988080:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783141818.038279:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1783141818.038296:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1783141818.038439:0:7171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad48b8fa reply state 0000000087b963d3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141818.038453:0:7171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783141818.039053:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1783141818.039167:0:7171:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1783141818.039249:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:9658:x1869759492671104:12345-192.168.203.27@tcp:36:chown.0 Request processed in 51334us (51959us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783141818.039258:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00010000:00010000:0.0:1783141818.039341:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.039351:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.039416:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.039423:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141818.039436:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.039444:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.039476:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648c722b00) 00010000:00010000:0.0:1783141818.039479:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783141818.039483:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.039490:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da898800 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141818.066797:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141818.067223:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492671232 00000100:00100000:2.0:1783141818.067231:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492671232 00000100:00100000:2.0:1783141818.067285:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:2.0:1783141818.067293:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:9659:x1869759492671232:12345-192.168.203.27@tcp:101:touch.500 00010000:00010000:2.0:1783141818.067314:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141818.067329:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898807 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd7d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783141818.068149:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1783141818.068953:0:5787:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1578us 00010000:00010000:0.0:1783141818.074687:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141818.084779:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.084802:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.084813:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.084829:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.084836:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.084843:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.085254:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da89881c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.085268:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da89881c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.085275:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da89881c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141818.085351:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783141818.085368:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141818.085455:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da89881c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.085504:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.085511:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.085518:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.085523:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141818.085536:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.085544:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.086781:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722e00) 00010000:00010000:1.0:1783141818.086789:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141818.086797:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.086818:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da89880e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087058:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087067:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087073:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087078:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141818.087082:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087088:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087099:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94648becab00) 00010000:00010000:1.0:1783141818.087102:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141818.087105:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087110:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898815 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087153:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898807 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd7d expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087165:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da89881c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd7d expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.087180:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:1.0:1783141818.087182:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783141818.087185:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53600, rc 0) 00000100:00100000:1.0:1783141818.087256:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:9659:x1869759492671232:12345-192.168.203.27@tcp:101:touch.500 Request processed in 19961us (20466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141818.087265:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:2.0:1783141818.094318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141818.094447:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492671488 00000100:00100000:1.0:1783141818.094456:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492671488 00000100:00100000:1.0:1783141818.094545:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:1.0:1783141818.094564:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:9659:x1869759492671488:12345-192.168.203.27@tcp:101:touch.500 00010000:00010000:1.0:1783141818.094583:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141818.094601:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898823 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd84 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.095018:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.095033:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.095043:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.095110:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.095118:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.095136:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783141818.097414:0:5788:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1783141818.098241:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898838 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098258:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098270:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098304:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098312:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098320:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098326:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141818.098330:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098337:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098349:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:1.0:1783141818.098352:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141818.098886:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098894:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89882a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141818.098907:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bd01913 reply state 000000005a6bd336 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141818.098916:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783141818.098952:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898823 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd84 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098965:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd84 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.098971:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648becad00) 00010000:00010000:1.0:1783141818.098974:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141818.098976:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53000, rc 0) 00000100:00100000:1.0:1783141818.099082:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:9659:x1869759492671488:12345-192.168.203.27@tcp:101:touch.500 Request processed in 4527us (4772us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783141818.099091:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00010000:00010000:1.0:1783141818.104250:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.104265:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.104272:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.104297:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141818.104302:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.104309:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.104327:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2a24774b (ffff94648beca700) 00010000:00010000:1.0:1783141818.104330:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141818.104335:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.104341:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898831 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141818.106852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141818.107156:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492671744 00000100:00100000:1.0:1783141818.107165:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492671744 00000100:00100000:1.0:1783141818.107223:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:1.0:1783141818.107233:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:9659:x1869759492671744:12345-192.168.203.27@tcp:36:touch.500 00010000:00010000:1.0:1783141818.107290:0:7171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141818.107314:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898838 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd84 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.107332:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648becad00) 00010000:00010000:1.0:1783141818.107342:0:7171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141818.107393:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.107406:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.107428:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141818.107763:0:7171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dac09166 reply state 00000000ecdff935 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141818.107773:0:7171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141818.108099:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:9659:x1869759492671744:12345-192.168.203.27@tcp:36:touch.500 Request processed in 865us (1253us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783141818.108107:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00010000:00010000:3.0:1783141818.112292:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141818.112324:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141818.112332:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141818.112339:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141818.112343:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141818.112352:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141818.112382:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648becab00) 00010000:00010000:3.0:1783141818.112386:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141818.112390:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141818.112397:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898846 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141818.114603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141818.115106:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492671872 00000100:00100000:1.0:1783141818.115117:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492671872 00000100:00100000:1.0:1783141818.115171:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:1.0:1783141818.115180:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:9659:x1869759492671872:12345-192.168.203.27@tcp:101:touch.500 00010000:00010000:1.0:1783141818.115202:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141818.115222:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da89884d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd8b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.115280:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da89884d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd8b expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.115294:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da89884d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd8b expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.115311:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648beca700) 00010000:00010000:1.0:1783141818.115315:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783141818.115319:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52600, rc 0) 00000100:00100000:1.0:1783141818.115394:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:9659:x1869759492671872:12345-192.168.203.27@tcp:101:touch.500 Request processed in 215us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141818.115401:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:0.0:1783141818.119230:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141818.119324:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492672000 00000100:00100000:1.0:1783141818.119333:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492672000 00000100:00100000:1.0:1783141818.119388:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:1.0:1783141818.119396:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869759492672000:12345-192.168.203.27@tcp:8:touch.500 00010000:00080000:1.0:1783141818.119427:0:6586:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:1.0:1783141818.119455:0:6586:0:(genops.c:1406:class_connect()) connect: client 8c7e4ac0-9090-4366-bd86-d237f38a8cf1, cookie 0x279ffa91da898854 00002000:00100000:1.0:1783141818.119743:0:6586:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8c7e4ac0-9090-4366-bd86-d237f38a8cf1/ffff94649d14b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783141818.119757:0:6586:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783141818.119982:0:6586:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783141818.120010:0:6586:0:(import.c:65:import_set_state_nolock()) ffff94649d14e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141818.120077:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2365:x1869759492672000:12345-192.168.203.27@tcp:8:touch.500 Request processed in 679us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141818.120085:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:3.0:1783141818.123109:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141818.123233:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492672128 00000100:00100000:0.0:1783141818.123243:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492672128 00000100:00100000:0.0:1783141818.123311:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:0.0:1783141818.123321:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:0:x1869759492672128:12345-192.168.203.27@tcp:2:touch.500 00000100:00080000:3.0:1783141818.123804:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141818.168736:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:0:x1869759492672128:12345-192.168.203.27@tcp:2:touch.500 Request processed in 45405us (45623us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783141818.168750:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000001:00080000:1.0:1783141818.169501:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1783141818.169516:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000100:00100000:1.0:1783141818.171645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141818.171929:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492672384 00000100:00100000:3.0:1783141818.171939:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492672384 00000100:00100000:3.0:1783141818.171989:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:3.0:1783141818.172000:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:9659:x1869759492672384:12345-192.168.203.27@tcp:35:touch.500 00000100:00100000:3.0:1783141818.172336:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:9659:x1869759492672384:12345-192.168.203.27@tcp:35:touch.500 Request processed in 336us (707us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783141818.172344:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:2.0:1783141818.188387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141818.188544:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492672512 00000100:00100000:1.0:1783141818.188553:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492672512 00000100:00100000:1.0:1783141818.188611:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:1.0:1783141818.188620:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:9660:x1869759492672512:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:1.0:1783141818.188655:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141818.188676:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89885b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd92 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.188772:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898862 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.188787:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.188799:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141818.188854:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783141818.188858:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141818.188895:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.188922:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89885b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd92 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.188941:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd92 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.188950:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:1.0:1783141818.188953:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141818.188957:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53400, rc 0) 00000100:00100000:1.0:1783141818.189020:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:9660:x1869759492672512:12345-192.168.203.27@tcp:101:rm.0 Request processed in 400us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141818.189027:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:0.0:1783141818.194546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141818.194697:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492672768 00000100:00100000:2.0:1783141818.194715:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492672768 00000100:00100000:2.0:1783141818.194803:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:2.0:1783141818.194814:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:9660:x1869759492672768:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1783141818.194848:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141818.194866:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fd99 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141818.194995:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783141818.195108:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898869 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd99 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.195123:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722e00) 00010000:00010000:2.0:1783141818.195127:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141818.195132:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd99 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.195145:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0e00, rc 0) 00000100:00100000:2.0:1783141818.195204:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:9660:x1869759492672768:12345-192.168.203.27@tcp:101:rm.0 Request processed in 391us (679us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1783141818.195211:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:3.0:1783141818.209233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141818.209449:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492672896 00000100:00100000:1.0:1783141818.209500:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492672896 00000100:00100000:1.0:1783141818.209564:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:1.0:1783141818.209573:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:9660:x1869759492672896:12345-192.168.203.27@tcp:37:rm.0 00000100:00100000:1.0:1783141818.216874:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:9660:x1869759492672896:12345-192.168.203.27@tcp:37:rm.0 Request processed in 7223us (7571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141818.216899:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:0.0:1783141818.226698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141818.226777:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492673152 00000100:00100000:1.0:1783141818.226788:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492673152 00000100:00100000:1.0:1783141818.226882:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:1.0:1783141818.226892:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:9660:x1869759492673152:12345-192.168.203.27@tcp:35:rm.0 00000100:00100000:1.0:1783141818.227129:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:9660:x1869759492673152:12345-192.168.203.27@tcp:35:rm.0 Request processed in 237us (439us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783141818.227138:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:3.0:1783141818.234126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141818.234232:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492673408 00000100:00100000:2.0:1783141818.234242:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492673408 00000100:00100000:2.0:1783141818.234302:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:2.0:1783141818.234313:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:9660:x1869759492673408:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1783141818.234336:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141818.234357:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fda0 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.234518:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89887e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.234550:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89887e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.234638:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89887e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141818.234850:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783141818.235064:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fda0 expref: 17 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.235083:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89887e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fda0 expref: 16 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.235092:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:2.0:1783141818.235095:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783141818.235098:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1800, rc 0) 00000100:00100000:2.0:1783141818.235204:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:9660:x1869759492673408:12345-192.168.203.27@tcp:101:rm.0 Request processed in 892us (1085us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783141818.235212:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:0.0:1783141818.240296:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141818.240372:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492673536 00000100:00100000:2.0:1783141818.240382:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492673536 00000100:00100000:2.0:1783141818.240444:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:2.0:1783141818.240453:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:9660:x1869759492673536:12345-192.168.203.27@tcp:41:rm.0 00000004:00000024:2.0:1783141818.240563:0:7171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1783141818.240641:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:9660:x1869759492673536:12345-192.168.203.27@tcp:41:rm.0 Request processed in 188us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141818.240656:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:0.0:1783141818.245020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141818.245202:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492673664 00000100:00100000:2.0:1783141818.245212:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492673664 00000100:00100000:2.0:1783141818.245270:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:2.0:1783141818.245280:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:9660:x1869759492673664:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1783141818.245303:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141818.245322:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da89888c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fda7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245387:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245402:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245413:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245427:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245435:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245441:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245785:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8988a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245862:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8988a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245887:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8988a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141818.245916:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783141818.245920:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141818.245935:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8988a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245946:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8988a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245954:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245960:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245967:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245973:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141818.245977:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245984:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.245995:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:2.0:1783141818.245998:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141818.246003:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246019:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898893 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246033:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246038:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246043:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246048:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141818.246050:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246055:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246064:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2a24774b (ffff94648c722200) 00010000:00010000:2.0:1783141818.246066:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141818.246069:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246073:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89889a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246104:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da89888c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fda7 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246118:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8988a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fda7 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.246131:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648beca700) 00010000:00010000:2.0:1783141818.246133:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141818.246136:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0600, rc 0) 00000100:00100000:2.0:1783141818.246874:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:9660:x1869759492673664:12345-192.168.203.27@tcp:101:rm.0 Request processed in 1418us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141818.246884:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:3.0:1783141818.253025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141818.255665:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492673920 00000100:00100000:2.0:1783141818.255678:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492673920 00000100:00100000:2.0:1783141818.255750:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:2.0:1783141818.255761:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:9660:x1869759492673920:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:2.0:1783141818.259419:0:10143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783141818.259479:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8988a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fda7 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.259508:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da89884d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd8b expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.259521:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648beca700) 00010000:00010000:2.0:1783141818.259764:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898862 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd92 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.259775:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:2.0:1783141818.259779:0:10143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141818.259870:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.259902:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.259912:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.259928:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.259935:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.259941:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.260049:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.260057:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.260063:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141818.264749:0:10143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1783141818.264767:0:10143:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325469306275ns, next at 326469303136ns, rc = 0 00010000:00010000:2.0:1783141818.264950:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.264968:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.264995:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265003:0:10143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265010:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265016:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265035:0:10143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783141818.265055:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265061:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265068:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265074:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141818.265079:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265086:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265097:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648c722f00) 00010000:00010000:2.0:1783141818.265100:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783141818.265110:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265116:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8988b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265135:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265141:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265147:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265153:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141818.265155:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265161:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265170:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:2.0:1783141818.265172:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141818.265175:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141818.265180:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8988a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141818.265189:0:10143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bba37afc reply state 000000003d70654b transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141818.265212:0:10143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141818.265299:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:9660:x1869759492673920:12345-192.168.203.27@tcp:36:rm.0 Request processed in 9537us (12280us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783141818.265307:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00010000:00010000:0.0:1783141818.265510:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141818.265517:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.265534:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0a00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141818.265538:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.265559:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.265569:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94648c722f00) 00010000:00010000:0.0:1783141818.265571:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783141818.265574:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.265579:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0a00/0x279ffa91da8988bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.265594:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141818.265596:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141818.265597:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141818.269681:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.269700:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.269712:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.269719:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141818.269725:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.269733:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.269750:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2a24774b (ffff94648c722200) 00010000:00010000:1.0:1783141818.269768:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141818.269774:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.269782:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da8988af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141818.271154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141818.273103:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492674176 00000100:00100000:2.0:1783141818.273114:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492674176 00000100:00100000:2.0:1783141818.273167:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:2.0:1783141818.273176:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:9660:x1869759492674176:12345-192.168.203.27@tcp:35:rm.0 00000100:00100000:2.0:1783141818.273739:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:9660:x1869759492674176:12345-192.168.203.27@tcp:35:rm.0 Request processed in 381us (2410us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783141818.273747:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:0.0:1783141818.282077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141818.282204:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492674432 00000100:00100000:1.0:1783141818.282214:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492674432 00000100:00100000:1.0:1783141818.282320:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:1.0:1783141818.282331:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:9660:x1869759492674432:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:1.0:1783141818.282383:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783141818.282419:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89887e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fda0 expref: 16 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282439:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da89881c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd7d expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282451:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648becac00) 00010000:00010000:1.0:1783141818.282509:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8987dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd6f expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282518:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722e00) 00010000:00010000:1.0:1783141818.282524:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141818.282545:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282557:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282583:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282605:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282612:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282619:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282893:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282902:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.282910:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141818.283526:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783141818.283543:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283551:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283558:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283563:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141818.283573:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283581:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283590:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94648beca700) 00010000:00010000:1.0:1783141818.283593:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783141818.283597:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283603:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da8988d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283621:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283639:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283645:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283651:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141818.283654:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283661:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283668:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648becad00) 00010000:00010000:1.0:1783141818.283671:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141818.283679:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141818.283686:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da8988c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141818.283699:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea600b5e reply state 0000000022b3f327 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141818.283707:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141818.283788:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:9660:x1869759492674432:12345-192.168.203.27@tcp:36:rm.0 Request processed in 1457us (1719us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783141818.283797:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00010000:00010000:0.0:1783141818.287304:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.287321:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.287330:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.287336:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141818.287341:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.287349:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.287381:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94648becae00) 00010000:00010000:0.0:1783141818.287385:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141818.287399:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141818.287406:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8988cb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141819.103128:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141820.124762:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141821.147098:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141821.470157:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510530816:0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.470262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141821.470429:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510530816 00000100:00100000:0.0:1783141821.470439:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510530816 00000100:00100000:0.0:1783141821.470520:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783141821.470541:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510530816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.472309:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510531328:0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.474214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141821.477015:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510530816:12345-0@lo:400:kworker.0 Request processed in 6472us (6740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141821.477034:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783141821.477167:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510530944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141821.477237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141821.477297:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510530944 00000100:00100000:0.0:1783141821.477307:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510530944 00000100:00100000:0.0:1783141821.477373:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783141821.477383:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510530944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141821.477430:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141821.477501:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510530944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141821.477508:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783141821.478589:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510530816:0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.478668:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510531328 00000100:00100000:2.0:1783141821.478675:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510531328 00000100:00100000:2.0:1783141821.478745:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783141821.478754:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510531328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.478832:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510531328:12345-0@lo:400:kworker.0 Request processed in 79us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141821.478839:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1783141821.478895:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b1b800 x1869759510531328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141821.478908:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510531328:0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.478953:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510531200:0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.478993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141821.479022:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783141821.479029:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510531072:0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.479050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141821.479089:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510531200 00000100:00100000:2.0:1783141821.479093:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510531200 00000100:00100000:2.0:1783141821.479124:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510531072 00000100:00100000:2.0:1783141821.479127:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510531072 00000100:00100000:2.0:1783141821.479145:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783141821.479151:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510531200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.479189:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510531200:12345-0@lo:400:kworker.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141821.479196:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783141821.479207:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783141821.479213:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510531072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.479238:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510531072:12345-0@lo:400:kworker.0 Request processed in 25us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141821.479244:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783141821.479289:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510531072:0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.479300:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510531200:0@lo:400:kworker.0 00000100:00080000:2.0:1783141821.479327:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141821.479338:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783141821.479404:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497434e00 x1869759510530944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141821.479422:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510530944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141821.482157:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141821.482196:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510531456:0@lo:400:kworker.0 00000100:00100000:2.0:1783141821.482284:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141821.482364:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510531456 00000100:00100000:0.0:1783141821.482375:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510531456 00000100:00100000:0.0:1783141821.482482:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783141821.482486:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510531584:0@lo:400:kworker.0 00000100:00100000:0.0:1783141821.482496:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510531456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141821.482680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141821.482740:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510531584 00000100:00100000:1.0:1783141821.482744:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510531584 00000100:00100000:1.0:1783141821.482793:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783141821.482801:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510531584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141821.482841:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510531584:12345-0@lo:400:kworker.0 Request processed in 41us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141821.482849:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1783141821.482895:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b19880 x1869759510531584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141821.482911:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510531584:0@lo:400:kworker.0 00000100:00080000:1.0:1783141821.482956:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783141821.482962:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141821.491593:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510531456:0@lo:400:kworker.0 00000100:00100000:0.0:1783141821.491618:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510531456:12345-0@lo:400:kworker.0 Request processed in 9121us (9329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141821.491634:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783141821.660721:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141821.660770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141821.660810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141821.660857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141821.660909:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492674560 00000100:00100000:2.0:1783141821.660924:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492674560 00000100:00100000:2.0:1783141821.660985:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 248 00000100:00100000:2.0:1783141821.660997:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2366:x1869759492674560:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141821.661086:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2366:x1869759492674560:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141821.661095:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 248 00000100:00100000:2.0:1783141821.661135:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492674816 00000100:00100000:2.0:1783141821.661139:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492674816 00000100:00100000:2.0:1783141821.661180:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:2.0:1783141821.661186:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497260380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2366:x1869759492674816:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141821.661216:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497260380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2366:x1869759492674816:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 30us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141821.661234:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00080000:2.0:1783141821.661361:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141821.661451:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492674688 00000100:00100000:1.0:1783141821.661457:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492674688 00000100:00100000:1.0:1783141821.661530:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492674944 00000100:00100000:1.0:1783141821.661534:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492674944 00000100:00100000:1.0:1783141821.661556:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:1.0:1783141821.661563:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:2366:x1869759492674688:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141821.661620:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:2366:x1869759492674688:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 57us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141821.661626:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:1.0:1783141821.661642:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 100 00000100:00100000:1.0:1783141821.661648:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492674944:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141821.661675:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492674944:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 27us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141821.661681:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 100 00000100:00080000:2.0:1783141821.662183:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1783141821.981072:0:7956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329185607529ns, next at 330185604229ns, rc = 0 00000100:00100000:3.0:1783141821.981147:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510531712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141821.981236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141821.981391:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510531712 00000100:00100000:1.0:1783141821.981401:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510531712 00000100:00100000:1.0:1783141821.981492:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783141821.981504:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510531712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141821.981552:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141821.981726:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510531712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 223us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141821.981734:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1783141821.981811:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946497437b80 x1869759510531712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141821.981833:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510531712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141822.173718:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783141822.344581:0:11481:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1783141823.085929:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1783141823.085972:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1783141823.086704:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141823.086732:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510531840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783141823.086827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141823.086908:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510531840 00000100:00100000:0.0:1783141823.086916:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510531840 00000100:00100000:0.0:1783141823.086981:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783141823.086991:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510531840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783141823.088130:0:6584:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1783141823.088183:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a4895b9, atime: 0x6a4895b9, ctime: 0x6a4895b9, blocks: 0x1 00010000:00010000:0.0:1783141823.088193:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.088216:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1783141823.088221:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141823.088229:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.088250:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.088281:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.088290:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783141823.088488:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1783141823.088783:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783141823.090701:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1869759510531840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3702us (3865us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783141823.090716:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1783141823.090764:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783141823.090781:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141823.090789:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.090803:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6a00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141823.090809:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.090821:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.090845:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.090868:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235f980c/0x279ffa91da8988d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.090892:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141823.090893:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141823.090895:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783141823.091661:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94649744fb80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1783141823.091675:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510531840:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783141823.197070:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783141823.536689:0:11529:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0959a530 20000000:00000080:1.0:1783141823.536705:0:11529:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9464ba747c00 uarg=0000000000000000 20000000:01000000:1.0:1783141823.536740:0:11529:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1783141823.536754:0:11529:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1783141823.536759:0:11529:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1783141823.539000:0:11530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1783141823.539362:0:11529:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1783141823.549713:0:11529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1783141823.549764:0:11529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1783141823.549813:0:11529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1783141823.549829:0:11529:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783141823.549847:0:11529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.549868:0:11529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd5a expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.549876:0:11529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd61 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.549893:0:11529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898789 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.549899:0:11529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da898797 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.549906:0:11529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8987a5 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.549913:0:11529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.549953:0:11529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8987a5 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.549967:0:11529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8987a5 expref: 18 pid: 5782 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141823.549981:0:11529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510531968:0@lo:104: 00000100:00100000:3.0:1783141823.550043:0:11529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141823.550102:0:11529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898797 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.550110:0:11529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898797 expref: 18 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141823.550117:0:11529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510532096:0@lo:104: 00000100:00100000:3.0:1783141823.550138:0:11529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141823.550159:0:11529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da898789 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.550175:0:11529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da898789 expref: 18 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141823.550183:0:11529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510532224:0@lo:104: 00000100:00100000:3.0:1783141823.550208:0:11529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783141823.550225:0:11529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd61 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.550236:0:11529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd61 expref: 12 pid: 5780 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141823.550245:0:11529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510532352:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141823.550291:0:11529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd5a expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141823.550299:0:11529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd5a expref: 12 pid: 5782 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141823.550306:0:11529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510532480:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141823.550323:0:11529:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141823.552520:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783141823.552541:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510531968 00000100:00100000:0.0:1783141823.552550:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510531968 00000100:00100000:0.0:1783141823.552595:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510532096 00000100:00100000:0.0:1783141823.552599:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510532096 00000100:00100000:0.0:1783141823.552611:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510532224 00000100:00100000:0.0:1783141823.552613:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510532224 00000100:00100000:0.0:1783141823.552631:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783141823.552639:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+5:11529:x1869759510531968:12345-0@lo:104: 00010000:00010000:0.0:1783141823.552655:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.552736:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141823.552742:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+5:11529:x1869759510531968:12345-0@lo:104: Request processed in 104us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141823.552749:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783141823.552766:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783141823.552772:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+4:11529:x1869759510532096:12345-0@lo:104: 00010000:00010000:0.0:1783141823.552779:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.552833:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783141823.552839:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+4:11529:x1869759510532096:12345-0@lo:104: Request processed in 67us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141823.552845:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783141823.552857:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783141823.552863:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d137050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:11529:x1869759510532224:12345-0@lo:104: 00010000:00010000:0.0:1783141823.552870:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.552915:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783141823.552920:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d137050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:872ec41a-f648-467b-b036-39669ac398c4+3:11529:x1869759510532224:12345-0@lo:104: Request processed in 59us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141823.552925:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1783141823.553113:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783141823.553120:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553128:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141823.553131:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553140:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141823.553147:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141823.553152:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141823.553257:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553341:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141823.553370:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553377:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff94649d0d6800/0x279ffa91da8987a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8987ac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553392:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141823.553395:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553401:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6e00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141823.553404:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553411:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141823.553418:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141823.553423:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141823.553438:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553443:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141823.553483:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553557:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da898797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89879e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553566:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141823.553569:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553575:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53200 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141823.553578:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553585:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141823.553600:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141823.553605:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141823.553621:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553626:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141823.553632:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553639:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946496f53200/0x279ffa91da898789 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da898790 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.553652:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141823.553659:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141823.553661:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141823.553668:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141823.553683:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510532736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141823.553725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141823.553765:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141823.553771:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510532864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141823.553794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141823.553820:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510532736 00000100:00100000:0.0:1783141823.553824:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510532736 00010000:00010000:0.0:1783141823.553844:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898797 expref: 19 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141823.553866:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510532864 00000100:00100000:0.0:1783141823.553868:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510532864 00010000:00010000:0.0:1783141823.553879:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898789 expref: 20 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.554044:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141823.554193:0:11529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510531968:0@lo:104: 00000100:00100000:3.0:1783141823.554204:0:11529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510532096:0@lo:104: 00000100:00100000:3.0:1783141823.554211:0:11529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510532224:0@lo:104: 00000100:00100000:0.0:1783141823.554446:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783141823.554456:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+20:3305:x1869759510532736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141823.554547:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141823.554555:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898797 expref: 20 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.554566:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898797 expref: 20 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.554580:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2174a00/0x279ffa91da89879e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898797 expref: 20 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.554616:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141823.554653:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510532736:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141823.554660:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783141823.554674:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783141823.554680:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+18:3305:x1869759510532864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141823.554687:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141823.554691:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da898789 expref: 18 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.554699:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da898789 expref: 18 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.554709:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0800/0x279ffa91da898790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da898789 expref: 18 pid: 5780 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141823.554717:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141823.554738:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:872ec41a-f648-467b-b036-39669ac398c4+17:3305:x1869759510532864:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141823.554745:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783141823.554932:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510532864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141823.554953:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510532736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141823.555044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141823.555663:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510532608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783141823.555702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141823.556125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141823.556237:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492675072 00000100:00100000:2.0:1783141823.556244:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492675072 00010000:00010000:2.0:1783141823.556284:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd61 expref: 13 pid: 5780 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141823.556303:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510532608 00000100:00100000:2.0:1783141823.556306:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510532608 00010000:00010000:2.0:1783141823.556316:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8987a5 expref: 17 pid: 5782 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141823.556324:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492675200 00000100:00100000:2.0:1783141823.556327:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492675200 00010000:00010000:2.0:1783141823.556336:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd5a expref: 14 pid: 5782 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141823.556347:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:2.0:1783141823.556354:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+14:2368:x1869759492675072:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141823.556366:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141823.556371:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd61 expref: 14 pid: 5780 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556380:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd61 expref: 14 pid: 5780 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556396:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141823.556453:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+14:2368:x1869759492675072:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 99us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141823.556481:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:2.0:1783141823.556654:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783141823.556661:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+17:3308:x1869759510532608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141823.556670:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141823.556675:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8987a5 expref: 17 pid: 5782 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556685:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8987a5 expref: 17 pid: 5782 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556695:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94649d0d7e00/0x279ffa91da8987ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8987a5 expref: 17 pid: 5782 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556707:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141823.556740:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+16:3308:x1869759510532608:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141823.556747:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783141823.556760:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:2.0:1783141823.556767:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492675200:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141823.556774:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141823.556779:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd5a expref: 13 pid: 5782 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556787:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd5a expref: 13 pid: 5782 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556798:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556811:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556825:0:6600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556833:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556840:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556848:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556854:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141823.556859:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556867:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.556877:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.557083:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141823.557109:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492675200:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 342us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141823.557117:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00010000:00010000:2.0:1783141823.557751:0:11529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2174600/0x279ffa91da898782 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd61 expref: 12 pid: 5780 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141823.557777:0:11529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510532352:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141823.557792:0:11529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94649d0d7a00/0x279ffa91da89877b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd5a expref: 11 pid: 5782 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141823.557801:0:11529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11529:1869759510532480:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141823.557832:0:11529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.557842:0:11529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.557848:0:11529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141823.557853:0:11529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2175600/0x279ffa91da8988e0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141823.559515:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510532608:0@lo:103:ldlm_bl.0 00000001:00080000:1.0:1783141823.605511:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1783141824.218910:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783141824.731069:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783141824.731077:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946381363000 from 7 10000000:01000000:0.0:1783141824.731082:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141824.731129:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141824.731141:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141824.731166:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141824.731190:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510532992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141824.731273:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.731335:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486bc5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141824.731453:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510532992 00000100:00100000:2.0:1783141824.731479:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510532992 00000100:00100000:2.0:1783141824.731537:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1783141824.731547:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+16:5784:x1869759510532992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141824.731560:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141824.731573:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a0a00/0x279ffa91da8988ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8988e7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141824.731605:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0a00/0x279ffa91da8988ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8988e7 expref: 17 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141824.731625:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a0a00/0x279ffa91da8988ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8988e7 expref: 17 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141824.731634:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0a00, rc 0) 00000100:00100000:2.0:1783141824.731682:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510532992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.731688:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783141824.731840:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510532992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141824.731857:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141824.731865:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141824.731918:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141824.731944:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.731977:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486bc5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141824.732085:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510533120 00000100:00100000:3.0:1783141824.732089:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510533120 00000100:00100000:3.0:1783141824.732121:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1783141824.732129:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510533120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141824.732375:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510533120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.732381:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783141824.732611:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141824.732644:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141824.732682:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.732706:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486bc5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141824.732761:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510533248 00000100:00100000:2.0:1783141824.732766:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510533248 00000100:00100000:2.0:1783141824.732799:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1783141824.732806:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510533248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141824.732960:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510533248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.732967:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783141824.733097:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141824.733758:0:11543:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11543:1869759510533376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141824.733800:0:11543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.733832:0:11543:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486bc5180 going to sleep for 11 seconds 00000100:00100000:1.0:1783141824.733883:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510533376 00000100:00100000:1.0:1783141824.733887:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510533376 00000100:00100000:1.0:1783141824.733920:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783141824.733926:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648762e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:11543:x1869759510533376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141824.734089:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648762e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+17:11543:x1869759510533376:12345-0@lo:502:llog_process_th.0 Request processed in 162us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141824.734097:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783141824.734453:0:11543:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11543:1869759510533376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141824.734509:0:11543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141824.734518:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141824.734520:0:11543:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783141824.734529:0:11543:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946381363000 00000020:00000080:0.0:1783141824.734531:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783141824.734616:0:11543:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11543:1869759510533504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141824.734652:0:11543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.734674:0:11543:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486bc5180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141824.734726:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510533504 00000100:00100000:3.0:1783141824.734732:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510533504 00000100:00100000:0.0:1783141824.734759:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141824.734761:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783141824.734772:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648762d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:11543:x1869759510533504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141824.734939:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648762d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+17:11543:x1869759510533504:12345-0@lo:502:llog_process_th.0 Request processed in 168us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.734947:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783141824.734972:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492675328 00000100:00100000:3.0:1783141824.734975:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492675328 00000100:00100000:3.0:1783141824.734993:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:3.0:1783141824.735001:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464851fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:5580:x1869759492675328:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141824.735010:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141824.735026:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175000/0x279ffa91da8988f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fdae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.735049:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175000/0x279ffa91da8988f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdae expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.735061:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175000/0x279ffa91da8988f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdae expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.735076:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175000, rc 0) 00000100:00100000:3.0:1783141824.735116:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464851fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492675328:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 116us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.735122:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 254 00000100:00100000:0.0:1783141824.737510:0:11543:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11543:1869759510533504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141824.737554:0:11543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141824.737564:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141824.737567:0:11543:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783141824.737574:0:11543:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:3.0:1783141824.738512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141824.738653:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492675456 00000100:00100000:0.0:1783141824.738660:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492675456 00000100:00100000:0.0:1783141824.738711:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 255 00000100:00100000:0.0:1783141824.738721:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464851f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492675456:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141824.739007:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464851f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492675456:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 285us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.739016:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 255 00000020:01000000:1.0:1783141824.740334:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783141824.740365:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141824.740378:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141824.740390:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141824.740401:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141824.740404:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff94649d28d000 from 7 10000000:01000000:1.0:1783141824.740407:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141824.740450:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141824.740501:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141824.740513:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141824.740536:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497435f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141824.740601:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141824.740647:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a34180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141824.744927:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510533632 00000100:00100000:3.0:1783141824.744942:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510533632 00000100:00100000:3.0:1783141824.745008:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783141824.745017:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+17:5784:x1869759510533632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141824.745033:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141824.745048:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175400/0x279ffa91da898903 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8988fc expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.745075:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175400/0x279ffa91da898903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8988fc expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.745085:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175400/0x279ffa91da898903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8988fc expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.745094:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175400, rc 0) 00000100:00100000:3.0:1783141824.745169:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510533632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (4569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.745176:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783141824.745268:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497435f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141824.745286:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141824.745295:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141824.745363:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497261180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141824.745396:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141824.745549:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464972810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141824.751385:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510533760 00000100:00100000:3.0:1783141824.751399:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510533760 00000100:00100000:3.0:1783141824.751449:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783141824.751485:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510533760:12345-0@lo:501:ll_cfg_requeue.0 00000040:00080000:0.0:1783141824.754957:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783141824.755898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141824.756618:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492675584 00000100:00100000:1.0:1783141824.756628:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492675584 00000100:00100000:1.0:1783141824.756681:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 258 00000100:00100000:1.0:1783141824.756689:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492675584:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141824.756911:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492675584:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 221us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141824.756919:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 258 00000100:00100000:3.0:1783141824.759258:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510533760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7793us (13853us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.759270:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783141824.763996:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497261180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141824.764075:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497261180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141824.764144:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141824.764189:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464972810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141824.766094:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510533888 00000100:00100000:0.0:1783141824.766107:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510533888 00000100:00100000:0.0:1783141824.766166:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1783141824.766176:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510533888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141824.766426:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510533888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.766434:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1783141824.766511:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497261180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510533888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141824.766722:0:11547:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11547:1869759510534016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141824.766902:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.766939:0:11547:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486bc5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141824.767455:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510534016 00000100:00100000:2.0:1783141824.767502:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510534016 00000100:00100000:2.0:1783141824.767544:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783141824.767553:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+18:11547:x1869759510534016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141824.767732:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+18:11547:x1869759510534016:12345-0@lo:502:llog_process_th.0 Request processed in 178us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.767739:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783141824.767958:0:11547:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11547:1869759510534016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141824.767987:0:11547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783141824.767996:0:11547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141824.767999:0:11547:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783141824.768016:0:11547:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94649d28d000 00000020:00000080:1.0:1783141824.768019:0:11547:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783141824.768094:0:11547:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497437b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11547:1869759510534144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141824.768132:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141824.768155:0:11547:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a34240 going to sleep for 11 seconds 00000100:00100000:0.0:1783141824.769035:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510534144 00000100:00100000:0.0:1783141824.769043:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510534144 00000100:00100000:0.0:1783141824.769074:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783141824.769081:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:11547:x1869759510534144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141824.769894:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141824.769960:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492675712 00000100:00100000:3.0:1783141824.769966:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492675712 00000100:00100000:3.0:1783141824.770031:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 262 00000100:00100000:3.0:1783141824.770040:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:9931:x1869759492675712:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783141824.770245:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:9931:x1869759492675712:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 205us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.770253:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 262 00000100:00100000:0.0:1783141824.770260:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+18:11547:x1869759510534144:12345-0@lo:502:llog_process_th.0 Request processed in 1180us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.770267:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1783141824.773912:0:11547:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497437b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11547:1869759510534144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783141824.773956:0:11547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783141824.773965:0:11547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783141824.773968:0:11547:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783141824.773977:0:11547:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783141824.774126:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783141824.774147:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141824.774157:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141824.774168:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141824.774178:0:5784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783141824.774180:0:5784:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946489ce7800 from 7 10000000:01000000:1.0:1783141824.774183:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141824.774214:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141824.774222:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141824.774231:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141824.774250:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497437b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510534272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783141824.774307:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141824.774343:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a34240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141824.774359:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510534272 00000100:00100000:1.0:1783141824.774364:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510534272 00000100:00100000:1.0:1783141824.774406:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783141824.774413:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+18:5784:x1869759510534272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141824.774427:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141824.774438:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946496f53a00/0x279ffa91da898911 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89890a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141824.777006:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f53a00/0x279ffa91da898911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89890a expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141824.777029:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946496f53a00/0x279ffa91da898911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89890a expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141824.777043:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53a00, rc 0) 00000100:00100000:1.0:1783141824.777506:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510534272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3089us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141824.777515:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783141824.777716:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497437b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510534272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141824.777738:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141824.777749:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141824.777822:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510534400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141824.777856:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.777884:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486bc5840 going to sleep for 11 seconds 00000100:00100000:3.0:1783141824.779926:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510534400 00000100:00100000:3.0:1783141824.779939:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510534400 00000100:00100000:3.0:1783141824.779987:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783141824.779996:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510534400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141824.780052:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141824.780078:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492675840 00000100:00100000:1.0:1783141824.780178:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492675840 00000100:00100000:1.0:1783141824.780205:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 265 00000100:00100000:1.0:1783141824.780213:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:9931:x1869759492675840:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783141824.780253:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510534400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.780262:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783141824.780308:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510534400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141824.780356:0:5784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510534528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141824.780398:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141824.780431:0:5784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfff2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141824.780446:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510534528 00000100:00100000:3.0:1783141824.780450:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510534528 00000100:00100000:1.0:1783141824.780557:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:9931:x1869759492675840:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 344us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141824.780564:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 265 00000100:00100000:3.0:1783141824.782755:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783141824.782772:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510534528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141824.783105:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:5784:x1869759510534528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 338us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.783113:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783141824.783177:0:5784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:872ec41a-f648-467b-b036-39669ac398c4:5784:1869759510534528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141824.783378:0:11550:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11550:1869759510534656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141824.783422:0:11550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141824.783450:0:11550:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bfff2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141824.783887:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510534656 00000100:00100000:1.0:1783141824.783894:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510534656 00000100:00100000:1.0:1783141824.783964:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783141824.783972:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:11550:x1869759510534656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141824.784158:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:11550:x1869759510534656:12345-0@lo:502:llog_process_th.0 Request processed in 187us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141824.784165:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783141824.785060:0:11550:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11550:1869759510534656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141824.785104:0:11550:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141824.785114:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141824.785116:0:11550:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783141824.785124:0:11550:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946489ce7800 00000020:00000080:0.0:1783141824.785126:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783141824.785210:0:11550:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11550:1869759510534784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141824.785265:0:11550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141824.785298:0:11550:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486bc5540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141824.785328:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510534784 00000100:00100000:1.0:1783141824.785335:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510534784 00000100:00100000:1.0:1783141824.785572:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783141824.785593:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:11550:x1869759510534784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141824.785881:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:11550:x1869759510534784:12345-0@lo:502:llog_process_th.0 Request processed in 299us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141824.785890:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783141824.787562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141824.789784:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492675968 00000100:00100000:3.0:1783141824.789799:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492675968 00000100:00100000:3.0:1783141824.789865:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 269 00000100:00100000:3.0:1783141824.789876:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:5580:x1869759492675968:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141824.789892:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141824.789909:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2174200/0x279ffa91da898918 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fdb5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.789937:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2174200/0x279ffa91da898918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdb5 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.789948:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2174200/0x279ffa91da898918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdb5 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.789957:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174200, rc 0) 00000100:00100000:3.0:1783141824.790015:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492675968:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 141us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.790021:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 269 00000100:00100000:0.0:1783141824.790658:0:11550:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:872ec41a-f648-467b-b036-39669ac398c4:11550:1869759510534784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783141824.790720:0:11550:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141824.790729:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141824.790731:0:11550:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783141824.790737:0:11550:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783141824.791805:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783141824.791842:0:5784:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783141824.791853:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141824.791865:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141824.797639:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141824.797718:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492676096 00000100:00100000:3.0:1783141824.797727:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492676096 00000100:00100000:3.0:1783141824.797780:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 270 00000100:00100000:3.0:1783141824.797791:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492676096:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141824.798085:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492676096:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 294us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.798094:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 270 00000100:00100000:1.0:1783141824.811998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141824.812779:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492676224 00000100:00100000:2.0:1783141824.812790:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492676224 00000100:00100000:2.0:1783141824.812839:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 271 00000100:00100000:2.0:1783141824.812847:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492676224:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141824.813058:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:5580:x1869759492676224:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 210us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141824.813067:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 271 00000100:00100000:1.0:1783141824.824108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141824.824571:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492676352 00000100:00100000:0.0:1783141824.824590:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492676352 00000100:00100000:0.0:1783141824.824647:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 272 00000100:00100000:0.0:1783141824.824657:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:9934:x1869759492676352:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783141824.824889:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:9934:x1869759492676352:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 232us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141824.824898:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 272 00000100:00100000:3.0:1783141824.841147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141824.841183:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492676480 00000100:00100000:3.0:1783141824.841192:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492676480 00000100:00100000:3.0:1783141824.841237:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 273 00000100:00100000:3.0:1783141824.841246:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:9934:x1869759492676480:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783141824.841492:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:9934:x1869759492676480:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 245us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141824.841501:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 273 00010000:00010000:0.0:1783141825.242852:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783141825.755153:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783141826.266780:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141826.586786:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510535296:0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.586816:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510535040:0@lo:400:kworker.0 00000100:00100000:3.0:1783141826.586866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141826.586868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141826.586951:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510534912:0@lo:400:kworker.0 00000100:00100000:2.0:1783141826.587045:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510535168:0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.593077:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510535552:0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.593159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141826.593233:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510535040 00000100:00100000:0.0:1783141826.593241:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510535040 00000100:00100000:0.0:1783141826.593292:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783141826.593300:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510535040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.593356:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510535040:12345-0@lo:400:kworker.0 Request processed in 56us (6491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141826.593363:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783141826.593404:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510535040:0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.593654:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510535296 00000100:00100000:0.0:1783141826.593658:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510535296 00000100:00100000:0.0:1783141826.593694:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510535552 00000100:00100000:0.0:1783141826.593698:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510535552 00000100:00100000:1.0:1783141826.593699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141826.593721:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783141826.593730:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510535296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141826.593740:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510535424:0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.593770:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510535296:12345-0@lo:400:kworker.0 Request processed in 41us (6909us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141826.593776:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783141826.593781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141826.593791:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783141826.593799:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510535552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141826.593810:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510535424 00000100:00100000:1.0:1783141826.593815:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510535424 00000100:00100000:0.0:1783141826.593832:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510535552:12345-0@lo:400:kworker.0 Request processed in 34us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141826.593838:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141826.593850:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1783141826.593856:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141826.593861:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510535424:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783141826.593862:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783141826.593866:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141826.593887:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1783141826.593901:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94649744fb80, transno 4294967300 00000100:00100000:1.0:1783141826.593903:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510535424:12345-0@lo:400:kworker.0 Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141826.593912:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783141826.593916:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510535552:0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.593965:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510535424:0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.594022:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510534912 00000100:00100000:0.0:1783141826.594026:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510534912 00000100:00100000:0.0:1783141826.594050:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1783141826.594056:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510534912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.594090:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510534912:12345-0@lo:400:kworker.0 Request processed in 36us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141826.594095:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1783141826.594122:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510534912:0@lo:400:kworker.0 00010000:00080000:3.0:1783141826.595770:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b1a680 x1869759510535296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141826.595805:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510535296:0@lo:400:kworker.0 00000100:00100000:3.0:1783141826.595827:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141826.595836:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510535680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141826.595880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141826.599621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141826.599761:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510535168 00000100:00100000:1.0:1783141826.599782:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510535168 00000100:00100000:1.0:1783141826.599845:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783141826.599856:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510535168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141826.599916:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510535168:12345-0@lo:400:kworker.0 Request processed in 62us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141826.599934:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1783141826.600174:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141826.600204:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510535168:0@lo:400:kworker.0 00000100:00100000:0.0:1783141826.604998:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510535680 00000100:00100000:0.0:1783141826.605013:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510535680 00000100:00100000:0.0:1783141826.605078:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783141826.605098:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510535680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141826.605138:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141826.605223:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510535680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (9340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141826.605230:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1783141826.607653:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464b9d79c00 x1869759510535680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141826.607682:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510535680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141826.777902:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141826.777939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141826.778077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141826.778113:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141826.778140:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492676736 00000100:00100000:1.0:1783141826.778148:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492676736 00000100:00100000:1.0:1783141826.778191:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492676992 00000100:00100000:1.0:1783141826.778193:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492676992 00000100:00100000:1.0:1783141826.778355:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:1.0:1783141826.778367:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492676736:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141826.778447:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492676736:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 82us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141826.778453:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:1.0:1783141826.778519:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:1.0:1783141826.778527:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492676992:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141826.778551:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492676992:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141826.778557:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:3.0:1783141826.778923:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492676608 00000100:00100000:3.0:1783141826.778928:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492676608 00000100:00100000:3.0:1783141826.779075:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 275 00000100:00100000:3.0:1783141826.779090:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492676608:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141826.779123:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492676608:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 42us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141826.779129:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 275 00000100:00080000:2.0:1783141826.779350:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141826.779849:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492676864 00000100:00100000:0.0:1783141826.779856:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492676864 00000100:00100000:0.0:1783141826.779916:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:0.0:1783141826.779925:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492676864:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141826.779977:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492676864:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 53us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141826.780001:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00080000:3.0:1783141826.780174:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141827.098954:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510535808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141827.099019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141827.099280:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510535808 00000100:00100000:1.0:1783141827.099288:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510535808 00000100:00100000:1.0:1783141827.099341:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783141827.099362:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510535808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141827.099395:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141827.099647:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510535808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 286us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141827.099655:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783141827.099973:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510535808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141827.292841:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141828.314673:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141829.339412:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141830.362737:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141831.387291:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141831.706683:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510536064:0@lo:400:kworker.0 00000100:00100000:3.0:1783141831.706801:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510536192:0@lo:400:kworker.0 00000100:00100000:1.0:1783141831.706813:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141831.706869:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510536064 00000100:00100000:0.0:1783141831.706877:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510536064 00000100:00100000:0.0:1783141831.706929:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783141831.706938:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510536064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141831.706974:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510535936:0@lo:400:kworker.0 00000100:00100000:3.0:1783141831.711970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141831.712044:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141831.712056:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510536320:0@lo:400:kworker.0 00000100:00100000:3.0:1783141831.712113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141831.712158:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510536320 00000100:00100000:3.0:1783141831.712166:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510536320 00000100:00100000:3.0:1783141831.712225:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783141831.712233:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510536320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141831.712287:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510536320:12345-0@lo:400:kworker.0 Request processed in 55us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141831.712294:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1783141831.712313:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783141831.712356:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946482f4d880 x1869759510536320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141831.712370:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510536320:0@lo:400:kworker.0 00000100:00100000:1.0:1783141831.712492:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510536576:0@lo:400:kworker.0 00000100:00100000:1.0:1783141831.712542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141831.712574:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510536192 00000100:00100000:1.0:1783141831.712578:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510536192 00000100:00100000:1.0:1783141831.712610:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783141831.712617:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510536192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141831.712656:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510536192:12345-0@lo:400:kworker.0 Request processed in 39us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141831.712662:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783141831.712681:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510536576 00000100:00100000:1.0:1783141831.712685:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510536576 00000100:00100000:1.0:1783141831.712717:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783141831.712723:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510536576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141831.712753:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510536576:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141831.712758:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1783141831.712774:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783141831.712777:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141831.712793:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510536192:0@lo:400:kworker.0 00000100:00100000:0.0:1783141831.712881:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510536064:12345-0@lo:400:kworker.0 Request processed in 5942us (6068us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141831.712889:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783141831.712998:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510536576:0@lo:400:kworker.0 00000100:00100000:1.0:1783141831.713015:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510536064:0@lo:400:kworker.0 00000100:00100000:1.0:1783141831.713074:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510536704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141831.713104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141831.713217:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510536704 00000100:00100000:0.0:1783141831.713222:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510536704 00000100:00100000:2.0:1783141831.713334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141831.713360:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783141831.713369:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510536704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141831.713400:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141831.713416:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510536448:0@lo:400:kworker.0 00000100:00100000:0.0:1783141831.713446:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510536704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141831.713455:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783141831.713487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141831.713512:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510536448 00000100:00100000:2.0:1783141831.713516:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510536448 00000100:00080000:1.0:1783141831.713560:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141831.713575:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783141831.713584:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510536448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141831.713621:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510536448:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141831.713628:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783141831.713652:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510536448:0@lo:400:kworker.0 00010000:00080000:1.0:1783141831.713663:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b1bb80 x1869759510536704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141831.713679:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510536704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141831.714255:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510535936 00000100:00100000:3.0:1783141831.714261:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510535936 00000100:00100000:2.0:1783141831.718324:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783141831.718338:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510535936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141831.718446:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510535936:12345-0@lo:400:kworker.0 Request processed in 110us (5112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141831.718452:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1783141831.718820:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510535936:0@lo:400:kworker.0 00000100:00100000:3.0:1783141831.898814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141831.898858:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141831.898885:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141831.898919:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141831.898969:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492677120 00000100:00100000:0.0:1783141831.898979:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492677120 00000100:00100000:2.0:1783141831.898981:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492677376 00000100:00100000:2.0:1783141831.898988:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492677376 00000100:00100000:0.0:1783141831.899037:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 277 00000100:00100000:0.0:1783141831.899050:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492677120:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141831.899053:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:2.0:1783141831.899067:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492677376:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141831.899133:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492677120:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00080000:3.0:1783141831.899139:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141831.899153:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 277 00000100:00100000:1.0:1783141831.900050:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492677248 00000100:00100000:1.0:1783141831.900059:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492677248 00000100:00100000:1.0:1783141831.900118:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492677504 00000100:00100000:1.0:1783141831.900122:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492677504 00000100:00100000:1.0:1783141831.900147:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 109 00000100:00100000:1.0:1783141831.900156:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2366:x1869759492677248:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141831.904748:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492677376:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 5671us (5847us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141831.904762:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:2.0:1783141831.904824:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 110 00000100:00100000:2.0:1783141831.904837:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492677504:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141831.904896:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492677504:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 64us (5976us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141831.904902:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 110 00000100:00080000:2.0:1783141831.904949:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141831.908672:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2366:x1869759492677248:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 8507us (9802us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141831.908700:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 109 00000100:00100000:0.0:1783141832.220927:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510536832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141832.221005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141832.221432:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510536832 00000100:00100000:1.0:1783141832.221441:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510536832 00000100:00100000:1.0:1783141832.221543:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783141832.221553:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510536832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141832.221601:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141832.221894:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510536832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 327us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141832.221902:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783141832.222112:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510536832:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783141832.411077:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141833.436404:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141834.458699:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141835.482780:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783141835.995419:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783141836.507035:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141836.826769:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141836.826872:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141836.826900:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510537216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141836.826967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141836.827537:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510537088:0@lo:400:kworker.0 00000100:00100000:0.0:1783141836.827539:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510537216 00000100:00100000:0.0:1783141836.827550:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510537216 00000100:00100000:1.0:1783141836.827583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141836.827608:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510536960:0@lo:400:kworker.0 00000100:00100000:0.0:1783141836.827614:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783141836.827626:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510537216:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141836.827641:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1783141836.827661:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141836.827684:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510537088 00000100:00100000:1.0:1783141836.827690:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510537088 00000100:00100000:0.0:1783141836.827713:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510537216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141836.827722:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783141836.827726:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783141836.827735:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510537088:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1783141836.827765:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b1ad80 x1869759510537216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141836.827779:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510537088:12345-0@lo:400:kworker.0 Request processed in 44us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141836.827784:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510537216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141836.827791:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783141836.827815:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510536960 00000100:00100000:1.0:1783141836.827819:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510536960 00000100:00100000:1.0:1783141836.827844:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1783141836.827851:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510536960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141836.827861:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510537088:0@lo:400:kworker.0 00000100:00100000:0.0:1783141836.827890:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510536960:0@lo:400:kworker.0 00000100:00080000:3.0:1783141836.828164:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141836.828205:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510536960:12345-0@lo:400:kworker.0 Request processed in 353us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141836.828212:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783141836.828388:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510537344:0@lo:400:kworker.0 00000100:00100000:3.0:1783141836.828420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141836.828487:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510537344 00000100:00100000:1.0:1783141836.828513:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510537344 00000100:00100000:1.0:1783141836.828555:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783141836.828561:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510537344:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783141836.828623:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141836.828747:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510537600:0@lo:400:kworker.0 00000100:00100000:0.0:1783141836.828776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141836.828803:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141836.828817:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510537472:0@lo:400:kworker.0 00000100:00100000:0.0:1783141836.828842:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141836.828879:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510537472 00000100:00100000:0.0:1783141836.828896:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510537472 00000100:00100000:0.0:1783141836.828924:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783141836.828930:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510537472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141836.828972:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510537472:12345-0@lo:400:kworker.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141836.828979:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1783141836.828993:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141836.829011:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510537472:0@lo:400:kworker.0 00000100:00100000:2.0:1783141836.829153:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510537600 00000100:00100000:2.0:1783141836.829158:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510537600 00000100:00100000:2.0:1783141836.829198:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783141836.829206:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510537600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141836.829245:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510537600:12345-0@lo:400:kworker.0 Request processed in 40us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141836.829250:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783141836.829277:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510537600:0@lo:400:kworker.0 00000100:00080000:0.0:1783141836.829366:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141836.831633:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510537344:12345-0@lo:400:kworker.0 Request processed in 3062us (3204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141836.831647:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783141836.831738:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510537344:0@lo:400:kworker.0 00000100:00100000:1.0:1783141837.017548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141837.017591:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141837.017628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141837.017659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141837.017662:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492677888 00000100:00100000:2.0:1783141837.017673:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492677888 00000100:00100000:1.0:1783141837.017685:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492677760 00000100:00100000:1.0:1783141837.017691:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492677760 00000100:00100000:1.0:1783141837.017744:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492678016 00000100:00100000:2.0:1783141837.017748:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:1.0:1783141837.017750:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492678016 00000100:00100000:2.0:1783141837.017763:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492677888:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141837.017779:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:1.0:1783141837.017788:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492677760:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141837.017838:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492677888:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 78us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141837.017840:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492677760:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 50us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141837.017855:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:1.0:1783141837.017856:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:1.0:1783141837.017885:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:1.0:1783141837.017891:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492678016:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141837.017919:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492678016:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141837.017925:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00080000:1.0:1783141837.017971:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141837.017975:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141837.018034:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492677632 00000100:00100000:3.0:1783141837.018039:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492677632 00000100:00100000:3.0:1783141837.018074:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 279 00000100:00100000:3.0:1783141837.018080:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492677632:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141837.018123:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492677632:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 43us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141837.018129:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 279 00000100:00100000:0.0:1783141837.339993:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510537728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141837.340113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141837.340218:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510537728 00000100:00100000:2.0:1783141837.340234:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510537728 00000100:00100000:2.0:1783141837.340311:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783141837.340334:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510537728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783141837.340373:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141837.349901:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510537728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9559us (9778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141837.349916:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783141837.350137:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510537728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141837.531706:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141838.559397:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141839.581128:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141840.602923:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141841.626850:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141841.946842:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510538112:0@lo:400:kworker.0 00000100:00100000:2.0:1783141841.946955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141841.947023:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510538112 00000100:00100000:2.0:1783141841.947044:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783141841.947052:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510538112 00000100:00100000:2.0:1783141841.947054:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510537984:0@lo:400:kworker.0 00000100:00100000:2.0:1783141841.947087:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141841.947114:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649d1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510538496:0@lo:400:kworker.0 00000100:00100000:1.0:1783141841.947121:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510537984 00000100:00100000:1.0:1783141841.947127:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510537984 00000100:00100000:2.0:1783141841.947145:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141841.947183:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510538496 00000100:00100000:2.0:1783141841.947189:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510538496 00000100:00100000:1.0:1783141841.947258:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783141841.947264:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783141841.947278:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510538496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141841.947284:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510538112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141841.947551:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648503a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510537856:0@lo:400:kworker.0 00000100:00100000:2.0:1783141841.947631:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510538496:12345-0@lo:400:kworker.0 Request processed in 356us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141841.947641:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783141841.947692:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649d1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510538496:0@lo:400:kworker.0 00000100:00100000:2.0:1783141841.947758:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649d1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510538624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141841.947790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141841.947846:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510538624 00000100:00100000:2.0:1783141841.947858:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510538624 00000100:00100000:2.0:1783141841.947897:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783141841.947904:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510538624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141841.947941:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141841.947983:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510538624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141841.947989:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783141841.948016:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510538240:0@lo:400:kworker.0 00000100:00100000:2.0:1783141841.948041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141841.948070:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510538240 00000100:00100000:2.0:1783141841.948074:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510538240 00000100:00100000:2.0:1783141841.948096:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783141841.948102:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510538240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141841.948135:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510538240:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141841.948141:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1783141841.948170:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946485039180 x1869759510538240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141841.948182:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510538240:0@lo:400:kworker.0 00010000:00080000:2.0:1783141841.948205:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649d1af800 x1869759510538624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141841.948220:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649d1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510538624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141841.948268:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783141841.948278:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510537984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141841.948315:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510537984:12345-0@lo:400:kworker.0 Request processed in 40us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141841.948328:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1783141841.948347:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141841.948351:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141841.948354:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141841.948373:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510537984:0@lo:400:kworker.0 00000100:00100000:1.0:1783141841.952239:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510538112:12345-0@lo:400:kworker.0 Request processed in 4959us (5275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141841.952253:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783141841.952567:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510538112:0@lo:400:kworker.0 00000100:00100000:3.0:1783141841.952850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141841.955074:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649d1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510538368:0@lo:400:kworker.0 00000100:00100000:3.0:1783141841.955172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141841.955377:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510537856 00000100:00100000:0.0:1783141841.955389:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510537856 00000100:00100000:0.0:1783141841.955684:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783141841.955698:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3306:x1869759510537856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141841.956028:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3306:x1869759510537856:12345-0@lo:400:kworker.0 Request processed in 332us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141841.956037:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1783141841.956133:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510538368 00000100:00100000:1.0:1783141841.956139:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510538368 00000100:00100000:1.0:1783141841.956193:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783141841.956213:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510538368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141841.956254:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510538368:12345-0@lo:400:kworker.0 Request processed in 44us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141841.956260:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1783141841.956279:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141841.957007:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648503a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510537856:0@lo:400:kworker.0 00000100:00100000:3.0:1783141841.957028:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649d1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510538368:0@lo:400:kworker.0 00000100:00100000:1.0:1783141842.138130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141842.138344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141842.138858:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492678144 00000100:00100000:0.0:1783141842.138888:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492678144 00000100:00100000:0.0:1783141842.138969:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 281 00000100:00100000:0.0:1783141842.138982:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492678144:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141842.139079:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492678144:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 99us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141842.139088:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 281 00000100:00100000:2.0:1783141842.140727:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492678272 00000100:00100000:2.0:1783141842.140744:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492678272 00000100:00100000:2.0:1783141842.140843:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 119 00000100:00100000:2.0:1783141842.140854:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492678272:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141842.140943:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492678272:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 91us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141842.140951:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 119 00000100:00080000:1.0:1783141842.141101:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141842.168003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141842.168105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141842.168199:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492678528 00000100:00100000:3.0:1783141842.168211:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492678528 00000100:00100000:3.0:1783141842.168310:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:3.0:1783141842.168331:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2368:x1869759492678528:12345-192.168.203.27@tcp:400:kworker.0 00000100:00080000:1.0:1783141842.168729:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141842.168947:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2368:x1869759492678528:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 617us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141842.168957:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:2.0:1783141842.174836:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492678400 00000100:00100000:2.0:1783141842.174856:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492678400 00000100:00100000:2.0:1783141842.175050:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:2.0:1783141842.175062:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2365:x1869759492678400:12345-192.168.203.27@tcp:9:kworker.0 00000020:00000080:2.0:1783141842.175104:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898854 00000100:00080000:2.0:1783141842.175116:0:6587:0:(import.c:65:import_set_state_nolock()) ffff94649d14e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783141842.175185:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1783141842.175622:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+2:2365:x1869759492678400:12345-192.168.203.27@tcp:9:kworker.0 Request processed in 560us (7633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141842.175632:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00080000:1.0:1783141842.176502:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783141842.177510:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141842.460076:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141842.460104:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510538752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141842.460192:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141842.460374:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510538752 00000100:00100000:0.0:1783141842.460392:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510538752 00000100:00100000:0.0:1783141842.460451:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783141842.460487:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510538752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141842.460532:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141842.460596:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510538752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141842.460604:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783141842.460739:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510538752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141842.652096:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141843.674808:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783141844.070716:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000020:00000080:3.0:1783141844.070729:0:7506:0:(genops.c:906:class_export_put()) final put ffff94649d14b000/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000020:00000080:2.0:1783141844.070821:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff94649d14b000/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 for lustre-OST0001 00000020:00000080:2.0:1783141844.070892:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94649d14e800 for lustre-OST0001 00010000:00010000:3.0:1783141844.703059:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783141845.214222:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783141845.723185:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141846.746767:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141847.066648:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141847.066679:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510539264:0@lo:400:kworker.0 00000100:00100000:2.0:1783141847.066771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141847.066865:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510539264 00000100:00100000:1.0:1783141847.066875:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510539264 00000100:00100000:1.0:1783141847.066949:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783141847.066964:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510539264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141847.066981:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649d1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510539008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141847.067014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141847.067042:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141847.067048:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510539392:0@lo:400:kworker.0 00000100:00100000:2.0:1783141847.067074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141847.067105:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510539136:0@lo:400:kworker.0 00000100:00100000:2.0:1783141847.067136:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141847.067153:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510539648:0@lo:400:kworker.0 00000100:00100000:2.0:1783141847.067174:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141847.067194:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783141847.067201:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510538880:0@lo:400:kworker.0 00000100:00100000:1.0:1783141847.067230:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510539264:12345-0@lo:400:kworker.0 Request processed in 269us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141847.067240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141847.067260:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783141847.067266:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510539520:0@lo:400:kworker.0 00000100:00100000:1.0:1783141847.067282:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510539136 00000100:00100000:1.0:1783141847.067287:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510539136 00000100:00100000:2.0:1783141847.067293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141847.067389:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510539392 00000100:00100000:3.0:1783141847.067395:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510539392 00000100:00100000:3.0:1783141847.067441:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510539648 00000100:00100000:3.0:1783141847.067446:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510539648 00000100:00100000:3.0:1783141847.067489:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783141847.067519:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510539392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141847.067559:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510539392:12345-0@lo:400:kworker.0 Request processed in 43us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141847.067566:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783141847.067579:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783141847.067586:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510539648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141847.067615:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510539648:12345-0@lo:400:kworker.0 Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141847.067622:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783141847.067640:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510539008 00000100:00100000:3.0:1783141847.067644:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510539008 00000100:00100000:3.0:1783141847.067668:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783141847.067675:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510539008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141847.067708:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141847.067740:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510539008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141847.067746:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783141847.068282:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510539520 00000100:00100000:1.0:1783141847.068287:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510539520 00000100:00100000:1.0:1783141847.068312:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783141847.068319:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510539136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141847.068414:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510539136:12345-0@lo:400:kworker.0 Request processed in 95us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141847.068433:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783141847.068447:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783141847.068454:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510539520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141847.068503:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510539520:12345-0@lo:400:kworker.0 Request processed in 50us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141847.068510:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1783141847.068528:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783141847.068532:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141847.068535:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141847.069989:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510539520:0@lo:400:kworker.0 00000100:00100000:2.0:1783141847.070013:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510539136:0@lo:400:kworker.0 00000100:00100000:2.0:1783141847.070027:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510539648:0@lo:400:kworker.0 00000100:00100000:0.0:1783141847.070582:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510538880 00000100:00100000:0.0:1783141847.070592:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510538880 00000100:00100000:0.0:1783141847.070661:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1783141847.070672:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510538880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141847.070764:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510538880:12345-0@lo:400:kworker.0 Request processed in 94us (3523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141847.070772:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1783141847.071622:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510538880:0@lo:400:kworker.0 00010000:00080000:1.0:1783141847.074633:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464974ea300 x1869759510539392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783141863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141847.074654:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510539392:0@lo:400:kworker.0 00000100:00100000:1.0:1783141847.074674:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510539264:0@lo:400:kworker.0 00010000:00080000:1.0:1783141847.074686:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94649d1af800 x1869759510539008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141847.074705:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649d1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510539008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141847.261297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141847.261350:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141847.261384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141847.261403:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492678912 00000100:00100000:1.0:1783141847.261417:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492678912 00000100:00100000:2.0:1783141847.261433:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492678784 00000100:00100000:2.0:1783141847.261438:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492678784 00000100:00100000:2.0:1783141847.261676:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00100000:1.0:1783141847.261690:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 125 00000100:00100000:2.0:1783141847.261692:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492678784:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141847.261702:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492678912:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141847.261866:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492678912:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 166us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141847.261876:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 125 00000100:00100000:3.0:1783141847.261912:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492678656 00000100:00100000:3.0:1783141847.261918:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492678656 00000100:00100000:3.0:1783141847.261967:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 283 00000100:00100000:3.0:1783141847.261975:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492678656:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141847.262659:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492678784:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 964us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141847.262787:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492678656:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 812us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141847.262796:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 283 00000100:00100000:2.0:1783141847.262902:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00080000:2.0:1783141847.262930:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1783141847.274386:0:11712:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:10:45 (1783141845) 00000100:00100000:3.0:1783141847.578658:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141847.578694:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510539776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141847.578796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141847.579914:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510539776 00000100:00100000:0.0:1783141847.579962:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510539776 00000100:00100000:0.0:1783141847.580052:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783141847.580063:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510539776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141847.580117:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141847.580216:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510539776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141847.580224:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783141847.580606:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510539776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783141847.771855:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141848.685514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141848.694444:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492679040 00000100:00100000:1.0:1783141848.694709:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492679040 00000100:00100000:1.0:1783141848.694814:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:1.0:1783141848.694827:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:10202:x1869759492679040:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141848.694863:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141848.694892:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89891f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fdbc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141848.695209:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898926 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141848.695225:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141848.695241:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141848.695813:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783141848.695819:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141848.696204:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141848.696261:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89891f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdbc expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141848.696286:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898926 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdbc expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141848.696297:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648becaa00) 00010000:00010000:1.0:1783141848.696300:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141848.696305:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53e00, rc 0) 00000100:00100000:1.0:1783141848.696772:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:10202:x1869759492679040:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1943us (11325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141848.696782:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:1.0:1783141848.709770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141848.710090:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492679168 00000100:00100000:0.0:1783141848.710102:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492679168 00000100:00100000:0.0:1783141848.710177:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:0.0:1783141848.710189:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:10203:x1869759492679168:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141848.710217:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141848.710245:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89892d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fdc3 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.710339:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.710356:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.710369:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.710384:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.710391:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.710429:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.714382:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da898942 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.714422:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da898942 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.714437:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da898942 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141848.721273:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783141848.721287:0:10143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141848.721495:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da898942 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727122:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727132:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727139:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727145:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141848.727150:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727158:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727204:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648becaa00) 00010000:00010000:0.0:1783141848.727207:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141848.727214:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727221:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727241:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727247:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727253:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727257:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141848.727260:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727266:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727273:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94648a1adf00) 00010000:00010000:0.0:1783141848.727275:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141848.727279:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727284:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da89893b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727374:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89892d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdc3 expref: 8 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727389:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da898942 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdc3 expref: 7 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141848.727397:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94648a1ad000) 00010000:00010000:0.0:1783141848.727400:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141848.727402:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7e00, rc 0) 00000100:00100000:0.0:1783141848.729244:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:10203:x1869759492679168:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 19043us (19473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141848.729259:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:2.0:1783141848.740072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141848.740751:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492679424 00000100:00100000:3.0:1783141848.740764:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492679424 00000100:00100000:3.0:1783141848.740844:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:3.0:1783141848.740857:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:10203:x1869759492679424:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141848.740886:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141848.740912:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da898949 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fdca expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.741026:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.741044:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.741058:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.741236:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.741260:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.741274:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.743143:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da89895e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.743168:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da89895e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.743180:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da89895e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141848.743194:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1783141848.743400:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.743420:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.743427:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.743434:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141848.743438:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.743446:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.743481:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94648a1ad000) 00010000:00010000:3.0:1783141848.743485:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141848.743490:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.743497:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898950 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.744984:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.745007:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.745015:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.745020:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141848.745025:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.745032:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.745051:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff946489eed400) 00010000:00010000:3.0:1783141848.745055:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141848.745060:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.745179:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da898957 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.745726:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da898949 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdca expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.745744:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da89895e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdca expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141848.745752:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:3.0:1783141848.745755:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141848.745764:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6200, rc 0) 00000100:00100000:3.0:1783141848.745845:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:10203:x1869759492679424:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 4989us (5786us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1783141848.745854:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:2.0:1783141848.760065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141848.760668:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492679552 00000100:00100000:1.0:1783141848.760683:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492679552 00000100:00100000:1.0:1783141848.760764:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:1.0:1783141848.760778:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:10203:x1869759492679552:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783141848.760952:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:10203:x1869759492679552:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 Request processed in 169us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141848.760962:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00010000:00010000:0.0:1783141848.794661:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783141849.308430:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783141849.821570:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141850.728138:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141850.728279:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492679680 00000100:00100000:0.0:1783141850.728292:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492679680 00000100:00100000:0.0:1783141850.728375:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:0.0:1783141850.728389:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:10245:x1869759492679680:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141850.728430:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141850.728456:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da89896c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fdd1 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728567:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728583:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728606:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728624:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728632:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728638:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728932:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728941:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728947:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728954:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141850.728958:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728967:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.728982:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648becaa00) 00010000:00010000:0.0:1783141850.728985:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141850.728991:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729004:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729017:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729024:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729031:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729036:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141850.729039:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729045:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729053:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94648a1adf00) 00010000:00010000:0.0:1783141850.729056:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141850.729059:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729065:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89897a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729106:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da89896c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdd1 expref: 10 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729129:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648becaa00) 00010000:00010000:0.0:1783141850.729131:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141850.729136:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da89896c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdd1 expref: 10 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141850.729146:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6800, rc 0) 00000100:00100000:0.0:1783141850.729235:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:10245:x1869759492679680:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 849us (1112us total) trans 0 rc 301/301 00000100:00100000:0.0:1783141850.729244:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00080000:2.0:1783141850.729629:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141850.753593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141850.753804:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492679936 00000100:00100000:3.0:1783141850.753817:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492679936 00000100:00100000:3.0:1783141850.753885:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:3.0:1783141850.753896:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:10245:x1869759492679936:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:3.0:1783141850.753968:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141850.754010:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898926 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdbc expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.754034:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648becaa00) 00010000:00010000:3.0:1783141850.754045:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141850.754609:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.754627:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.754639:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.755051:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.755062:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.755069:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141850.762290:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783141850.762318:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.762331:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.762340:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.762347:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a7000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141850.762354:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.762364:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.762386:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141850.762389:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141850.763266:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.763280:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898981 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141850.763309:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d7f1a4f reply state 00000000961a9bea transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141850.763320:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141850.763514:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:10245:x1869759492679936:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 9613us (9930us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783141850.763543:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 37 00010000:00010000:1.0:1783141850.768904:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141850.768927:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141850.768936:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141850.768952:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a7a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141850.768958:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141850.768968:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141850.769004:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff946489eed900) 00010000:00010000:1.0:1783141850.769008:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141850.769014:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141850.769021:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898988 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.842890:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141850.875171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141850.875632:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492680064 00000100:00100000:2.0:1783141850.875645:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492680064 00000100:00100000:3.0:1783141850.876833:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:3.0:1783141850.876849:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:10253:x1869759492680064:12345-192.168.203.27@tcp:101:lctl.0 00010000:00010000:3.0:1783141850.876883:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141850.876929:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89898f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fdd8 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.877016:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6000/0x279ffa91da898996 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.877033:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6000/0x279ffa91da898996 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.877046:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6000/0x279ffa91da898996 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141850.877128:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783141850.877133:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783141850.877181:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6000/0x279ffa91da898996 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.877209:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89898f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdd8 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.877233:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6000/0x279ffa91da898996 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdd8 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.877241:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141850.877261:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141850.877265:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6000, rc 0) 00000100:00100000:3.0:1783141850.877385:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:10253:x1869759492680064:12345-192.168.203.27@tcp:101:lctl.0 Request processed in 538us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141850.877390:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:0.0:1783141850.959104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141850.959265:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492680192 00000100:00100000:2.0:1783141850.959278:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492680192 00000100:00100000:2.0:1783141850.959530:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:2.0:1783141850.959544:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:10259:x1869759492680192:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1783141850.959569:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141850.959595:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da89899d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fddf expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.959674:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.959692:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.959720:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.959741:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.959748:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.959756:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.959908:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8989b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.959917:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8989b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.959924:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8989b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141850.959959:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1783141850.959963:0:7171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141850.960003:0:7171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8989b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960016:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960024:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960042:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960048:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141850.960053:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960061:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960075:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:2.0:1783141850.960078:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141850.960083:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960090:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8989a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960105:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960111:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960118:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960123:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141850.960127:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960141:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960148:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94648c722e00) 00010000:00010000:2.0:1783141850.960150:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141850.960153:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960159:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da8989ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960192:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da89899d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fddf expref: 12 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960203:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8989b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fddf expref: 11 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.960210:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:2.0:1783141850.960212:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783141850.960215:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0600, rc 0) 00000100:00100000:2.0:1783141850.960282:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:10259:x1869759492680192:12345-192.168.203.27@tcp:101:bash.0 Request processed in 742us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141850.960290:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:2.0:1783141850.966831:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141850.966961:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492680448 00000100:00100000:3.0:1783141850.966974:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492680448 00000100:00100000:3.0:1783141850.967051:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:3.0:1783141850.967062:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:10259:x1869759492680448:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141850.967090:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141850.967116:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da8989b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fde6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.967362:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.967381:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.967404:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.975008:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.975028:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.975037:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783141850.976146:0:5788:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1783141850.976323:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.976334:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.976344:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.976379:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.976386:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.977806:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.977990:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a7a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141850.977996:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.978006:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.978023:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:3.0:1783141850.978026:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141850.978031:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.978057:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da8989c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141850.978076:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003f032b4 reply state 0000000061b6ee53 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141850.978086:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783141850.978134:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da8989b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fde6 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.978150:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fde6 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.978157:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946489eed900) 00010000:00010000:3.0:1783141850.978160:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141850.978162:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174a00, rc 0) 00000100:00100000:3.0:1783141850.978245:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:10259:x1869759492680448:12345-192.168.203.27@tcp:101:bash.0 Request processed in 11184us (11429us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783141850.978254:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 40 00010000:00010000:3.0:1783141850.981231:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.981253:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.981262:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.981269:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141850.981439:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.981449:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.981508:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff946489eed800) 00010000:00010000:3.0:1783141850.981513:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141850.981519:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141850.981525:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da8989c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141850.983926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141850.984164:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492680576 00000100:00100000:3.0:1783141850.984177:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492680576 00000100:00100000:3.0:1783141850.984235:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:3.0:1783141850.984245:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2365:x1869759492680576:12345-192.168.203.27@tcp:8:bash.0 00010000:00080000:3.0:1783141850.984285:0:10144:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:3.0:1783141850.984336:0:10144:0:(genops.c:1406:class_connect()) connect: client 8c7e4ac0-9090-4366-bd86-d237f38a8cf1, cookie 0x279ffa91da8989dc 00002000:00100000:3.0:1783141850.984351:0:10144:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8c7e4ac0-9090-4366-bd86-d237f38a8cf1/ffff9464874db000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783141850.984381:0:10144:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783141850.984700:0:10144:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783141850.984736:0:10144:0:(import.c:65:import_set_state_nolock()) ffff9464874de000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783141850.984823:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2365:x1869759492680576:12345-192.168.203.27@tcp:8:bash.0 Request processed in 576us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141850.984831:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:0.0:1783141850.992881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141850.996733:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492680704 00000100:00100000:2.0:1783141850.996752:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492680704 00000100:00100000:2.0:1783141850.996860:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:2.0:1783141850.996891:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:0:x1869759492680704:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1783141850.996915:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141850.996945:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fded expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783141850.996979:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141850.997002:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1783141850.997007:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141850.997019:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fded expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.997041:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fded expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141850.997057:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1600, rc 0) 00000100:00100000:2.0:1783141850.997140:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:0:x1869759492680704:12345-192.168.203.27@tcp:101:bash.0 Request processed in 252us (4273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141850.997147:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00080000:1.0:1783141850.997331:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141851.000887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141851.000988:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492680832 00000100:00100000:3.0:1783141851.001018:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492680832 00000100:00100000:3.0:1783141851.001089:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:3.0:1783141851.001100:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:10259:x1869759492680832:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141851.001125:0:10144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141851.001152:0:10144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fdf4 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.001191:0:10144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fded expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.001201:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141851.001207:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141851.001213:0:10144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 8 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.001254:0:10144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fded expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.001271:0:10144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fded expref: 8 pid: 6587 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141851.001287:0:10144:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10144:1869759510539904:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141851.001425:0:10144:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141851.007831:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141851.008024:0:10144:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10144:1869759510539904:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141851.008072:0:10144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 8 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.008128:0:10144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174600, rc 0) 00000100:00100000:3.0:1783141851.008264:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:10259:x1869759492680832:12345-192.168.203.27@tcp:101:bash.0 Request processed in 7164us (7390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141851.008274:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:0.0:1783141851.008416:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492680960 00000100:00100000:0.0:1783141851.008426:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492680960 00010000:00010000:0.0:1783141851.009646:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fded expref: 8 pid: 6587 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141851.009712:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:0.0:1783141851.009731:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492680960:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141851.009751:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141851.009778:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fded expref: 8 pid: 6587 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.009815:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fded expref: 8 pid: 6587 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.009848:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da8989e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fded expref: 8 pid: 6587 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.009868:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141851.009873:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141851.009883:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 7 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.009896:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 7 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.009942:0:5774:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 7 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141851.009960:0:5774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5774:1869759510540032:192.168.203.27@tcp:105: 00000100:00100000:0.0:1783141851.010050:0:5774:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcd540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141851.015820:0:5774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5774:1869759510540032:192.168.203.27@tcp:105: 00010000:00010000:2.0:1783141851.015861:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141851.015947:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2368:x1869759492680960:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 6223us (8130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141851.015959:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1783141851.017348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141851.017457:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492681216 00000100:00100000:1.0:1783141851.017521:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492681216 00000100:00100000:1.0:1783141851.017586:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1783141851.017597:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:10259:x1869759492681216:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:1.0:1783141851.018064:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:10259:x1869759492681216:12345-192.168.203.27@tcp:35:bash.0 Request processed in 466us (721us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783141851.018074:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:0.0:1783141851.098664:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141851.098752:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492681472 00000100:00100000:3.0:1783141851.098763:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492681472 00000100:00100000:3.0:1783141851.098824:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:3.0:1783141851.098836:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:10269:x1869759492681472:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141851.098860:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141851.098879:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da8989f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fdfb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141851.098986:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783141851.099108:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da8989f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdfb expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.099123:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141851.099126:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141851.099131:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da8989f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdfb expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.099145:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175600, rc 0) 00000100:00100000:3.0:1783141851.099335:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:10269:x1869759492681472:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 501us (679us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1783141851.099343:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:0.0:1783141851.106172:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141851.106911:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492681728 00000100:00100000:1.0:1783141851.106927:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492681728 00000100:00100000:1.0:1783141851.106988:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:1.0:1783141851.107278:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:10269:x1869759492681728:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1783141851.107901:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:10269:x1869759492681728:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 626us (1735us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783141851.109046:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:2.0:1783141851.236276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141851.237140:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492681856 00000100:00100000:0.0:1783141851.237155:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492681856 00000100:00100000:0.0:1783141851.237284:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:0.0:1783141851.237312:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:10275:x1869759492681856:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141851.237359:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141851.237389:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da8989ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe02 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.237525:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.237543:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.237557:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141851.237644:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783141851.237650:0:7171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141851.237681:0:7171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.237712:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da8989ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe02 expref: 18 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.237734:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe02 expref: 17 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.237744:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141851.237747:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141851.237752:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7600, rc 0) 00000100:00100000:0.0:1783141851.237947:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:10275:x1869759492681856:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 637us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141851.237956:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:2.0:1783141851.253132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141851.253428:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492682112 00000100:00100000:3.0:1783141851.253442:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492682112 00000100:00100000:3.0:1783141851.253561:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:3.0:1783141851.253573:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:10275:x1869759492682112:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141851.253602:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141851.253629:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898a0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe09 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.253895:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.253913:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.253928:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141851.253943:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783141851.254118:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da898a0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe09 expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.254144:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe09 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.254154:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946489eed900) 00010000:00010000:3.0:1783141851.254157:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141851.254162:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a7000, rc 0) 00000100:00100000:3.0:1783141851.254306:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:10275:x1869759492682112:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 733us (1188us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1783141851.254331:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:2.0:1783141851.257939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141851.258215:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492682368 00000100:00100000:3.0:1783141851.258228:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492682368 00000100:00100000:3.0:1783141851.258312:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:3.0:1783141851.258325:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:10275:x1869759492682368:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141851.258362:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141851.258388:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898a22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe10 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.259324:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898a29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.259349:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898a29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.259362:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898a29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141851.259379:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783141851.259595:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898a22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe10 expref: 22 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.259620:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898a29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe10 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.259630:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946489eed900) 00010000:00010000:3.0:1783141851.259634:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783141851.259638:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2043600, rc 0) 00000100:00100000:3.0:1783141851.265084:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:10275:x1869759492682368:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 6741us (7142us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783141851.265101:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:2.0:1783141851.265327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141851.265610:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492682496 00000100:00100000:3.0:1783141851.265621:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492682496 00000100:00100000:3.0:1783141851.265692:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:3.0:1783141851.265703:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:2368:x1869759492682496:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141851.265724:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141851.265771:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe09 expref: 21 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.265797:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946489eed900) 00010000:00010000:3.0:1783141851.265804:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141851.265869:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:2368:x1869759492682496:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 167us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141851.265877:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:0.0:1783141851.279386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141851.279606:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492682624 00000100:00100000:2.0:1783141851.279618:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492682624 00000100:00100000:2.0:1783141851.279684:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1783141851.279695:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2368:x1869759492682624:12345-192.168.203.27@tcp:1:lfs.0 00010000:00010000:2.0:1783141851.279762:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.279786:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 7 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.279795:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141851.279800:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141851.279805:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.279844:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 7 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.279858:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 7 pid: 10144 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141851.279873:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba9ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6587:1869759510540160:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141851.279999:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487f67780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141851.284990:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba9ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6587:1869759510540160:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141851.285033:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141851.288194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141851.288614:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492682752 00000100:00100000:1.0:1783141851.288624:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492682752 00002000:00100000:1.0:1783141851.288681:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff946485193480 x1869759492682752/t0(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:227/0 lens 504/0 e 0 to 0 dl 1783141862 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141851.288692:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946485193480 with x1869759492682752 ext(0->12) 00010000:00010000:1.0:1783141851.288702:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 8 pid: 10144 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.288718:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 8 pid: 10144 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141851.288726:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946485193480 00000100:00100000:1.0:1783141851.288791:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:1.0:1783141851.288801:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2369:x1869759492682752:12345-192.168.203.27@tcp:4:lfs.0 00000001:00100000:3.0:1783141851.346852:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000100:00100000:0.0:1783141851.352999:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2369:x1869759492682752:12345-192.168.203.27@tcp:4:lfs.0 Request processed in 64179us (64795us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783141851.353025:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00002000:00100000:0.0:1783141851.353057:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff946485193480 x1869759492682752/t4294967299(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:227/0 lens 504/448 e 0 to 0 dl 1783141862 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141851.353068:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946485193480 with x1869759492682752 ext(0->12) 00010000:00010000:0.0:1783141851.353083:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 9 pid: 10144 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.353102:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 9 pid: 10144 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141851.353109:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946485193480 00000100:00100000:2.0:1783141851.355922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141851.358840:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492682880 00000100:00100000:0.0:1783141851.358863:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492682880 00010000:00010000:0.0:1783141851.358935:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 9 pid: 10144 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141851.358997:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:0.0:1783141851.359009:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2366:x1869759492682880:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141851.359049:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783141851.359074:0:6600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783141851.359077:0:6600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783141850 00002000:00010000:0.0:1783141851.359080:0:6600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783141850 00002000:00010000:0.0:1783141851.359082:0:6600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783141850 00010000:00010000:0.0:1783141851.359089:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 9 pid: 10144 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.359104:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 9 pid: 10144 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.359135:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8989ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdf4 expref: 9 pid: 10144 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.359157:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141851.359162:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141851.359168:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.359180:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.359229:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141851.359312:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2366:x1869759492682880:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 304us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141851.359321:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00010000:00010000:2.0:1783141851.360486:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.360505:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.360547:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.360556:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.360566:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.360576:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141851.360582:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.360593:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.360614:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.360623:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d9e76bd/0x279ffa91da898a37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141851.360921:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2368:x1869759492682624:12345-192.168.203.27@tcp:1:lfs.0 Request processed in 81221us (81545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141851.360932:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1783141851.375281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141851.376609:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492683136 00000100:00100000:1.0:1783141851.376625:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492683136 00000100:00100000:1.0:1783141851.376710:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:1.0:1783141851.376721:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:10275:x1869759492683136:12345-192.168.203.27@tcp:35:lfs.0 00000004:00010000:1.0:1783141851.376811:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898a29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe10 expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141851.377154:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1783141851.377213:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1783141851.380935:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1783141851.381060:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.381086:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fde6 expref: 24 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.381095:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.381147:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fde6 expref: 24 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.381169:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fde6 expref: 24 pid: 5788 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141851.381187:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba9ed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1869759510540288:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141851.381615:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487f673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141851.392438:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141851.393284:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba9ed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1869759510540288:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141851.393410:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141851.393640:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492683264 00000100:00100000:0.0:1783141851.393651:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492683264 00010000:00010000:0.0:1783141851.393704:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fde6 expref: 25 pid: 5788 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141851.393751:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:0.0:1783141851.393762:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+25:2369:x1869759492683264:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141851.393780:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141851.393788:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fde6 expref: 25 pid: 5788 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.393802:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fde6 expref: 25 pid: 5788 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.393829:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da8989ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fde6 expref: 25 pid: 5788 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.393850:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946489eed900) 00010000:00010000:0.0:1783141851.393855:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.393865:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.393872:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.393902:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141851.394021:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:2369:x1869759492683264:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 260us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141851.394056:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 37 00010000:00010000:2.0:1783141851.398422:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.398519:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141851.398699:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783141851.398967:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1783141851.399149:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba9ed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1869759510540416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783141851.400504:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141851.400551:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141851.400928:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510540416 00000100:00100000:3.0:1783141851.400944:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510540416 00000100:00100000:3.0:1783141851.401038:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141851.401060:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1869759510540416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783141851.401212:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1869759510540416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 154us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141851.401220:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141851.401286:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba9ed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1869759510540416:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1783141851.401517:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1783141851.402232:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1783141851.402719:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba9ee680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1869759510540544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783141851.404373:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141851.404430:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141851.405170:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510540544 00000100:00100000:3.0:1783141851.405187:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510540544 00000100:00100000:3.0:1783141851.405272:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141851.405285:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1869759510540544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783141851.405699:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1869759510540544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 415us (2908us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783141851.405708:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141851.409292:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba9ee680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1869759510540544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783141851.409406:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1783141851.409511:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.409523:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.409531:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.409537:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141851.409542:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.409550:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.409579:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946489eed900) 00010000:00010000:2.0:1783141851.409582:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783141851.409587:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.409594:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898a3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783141851.409801:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783141851.410022:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1783141851.410034:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358614573739ns, next at 359614571772ns, rc = 0 00000001:00080000:2.0:1783141851.410041:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1783141851.410074:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff946489eed900) 00010000:00010000:2.0:1783141851.410078:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783141851.410085:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898a29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe10 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141851.413529:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:10275:x1869759492683136:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 36797us (38250us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783141851.413543:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000020:00080000:2.0:1783141851.413551:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783141851.418204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141851.419228:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492683392 00000100:00100000:0.0:1783141851.419244:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492683392 00000100:00100000:0.0:1783141851.419547:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:0.0:1783141851.419561:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:10275:x1869759492683392:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141851.419593:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141851.419623:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898a45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe17 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.419697:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898a45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe17 expref: 28 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.419717:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898a45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe17 expref: 28 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.419740:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141851.419745:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141851.419749:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6400, rc 0) 00000100:00100000:0.0:1783141851.419836:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:10275:x1869759492683392:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 278us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141851.419844:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:3.0:1783141851.428513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141851.428659:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492683648 00000100:00100000:0.0:1783141851.428672:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492683648 00000100:00100000:0.0:1783141851.428745:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:0.0:1783141851.428762:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:10275:x1869759492683648:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1783141851.429268:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:10275:x1869759492683648:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 511us (813us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1783141851.429293:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:2.0:1783141851.503002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141851.503094:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492683904 00000100:00100000:3.0:1783141851.503107:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492683904 00000100:00100000:3.0:1783141851.503183:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:3.0:1783141851.503194:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:10285:x1869759492683904:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141851.503228:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141851.503255:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe1e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141851.503427:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783141851.503623:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898a4c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe1e expref: 31 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.503642:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141851.503646:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141851.503652:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe1e expref: 31 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.503671:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2043400, rc 0) 00000100:00100000:3.0:1783141851.503775:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:10285:x1869759492683904:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 581us (785us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1783141851.503783:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:3.0:1783141851.509646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141851.509760:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492684032 00000100:00100000:2.0:1783141851.509772:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492684032 00000100:00100000:2.0:1783141851.509850:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:2.0:1783141851.509862:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:10285:x1869759492684032:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:2.0:1783141851.509962:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510001:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510017:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510036:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510043:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510050:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510172:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510181:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510188:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141851.510240:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510254:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510261:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510279:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510285:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141851.510290:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510311:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510326:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:2.0:1783141851.510330:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141851.510335:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510342:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510359:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510366:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510371:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510376:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141851.510380:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510404:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510414:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648c722e00) 00010000:00010000:2.0:1783141851.510416:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141851.510419:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510425:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898a61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510441:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510447:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510452:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510457:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141851.510718:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510725:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510734:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:2.0:1783141851.510736:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141851.510739:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.510756:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898a68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141851.510858:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:10285:x1869759492684032:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 995us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141851.510870:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:2.0:1783141851.520119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141851.520243:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492684288 00000100:00100000:0.0:1783141851.520255:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492684288 00000100:00100000:0.0:1783141851.520338:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:0.0:1783141851.520349:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:10285:x1869759492684288:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1783141851.520737:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+31:10285:x1869759492684288:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 388us (631us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1783141851.520746:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:1.0:1783141851.584579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141851.584744:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492684544 00000100:00100000:0.0:1783141851.584758:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492684544 00000100:00100000:0.0:1783141851.584829:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:0.0:1783141851.584840:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+31:10288:x1869759492684544:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141851.584874:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141851.584899:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898a6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe25 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585003:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585020:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585033:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585050:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585078:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585086:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585251:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585261:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585268:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141851.585280:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783141851.585425:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585433:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585440:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585447:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141851.585452:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585497:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585524:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141851.585528:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141851.585534:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585541:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898a76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585557:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585564:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585569:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585574:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141851.585577:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585583:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585590:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648a1ad600) 00010000:00010000:0.0:1783141851.585593:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141851.585596:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585602:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898a7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585669:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898a6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe25 expref: 34 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585684:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe25 expref: 33 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.585692:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141851.585695:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141851.585698:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7000, rc 0) 00000100:00100000:0.0:1783141851.585972:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:10288:x1869759492684544:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1131us (1406us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1783141851.585981:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:3.0:1783141851.589735:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141851.589862:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492684672 00000100:00100000:1.0:1783141851.589878:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492684672 00000100:00100000:1.0:1783141851.589953:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:1.0:1783141851.589964:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:10288:x1869759492684672:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:1.0:1783141851.590055:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.590075:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.590090:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.590122:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.590129:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.590137:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.590144:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141851.590150:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.590158:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.590172:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:1.0:1783141851.590193:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783141851.590199:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141851.590207:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898a92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141851.590317:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:10288:x1869759492684672:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 354us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141851.590327:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:2.0:1783141851.592631:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141851.592735:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492684928 00000100:00100000:0.0:1783141851.592747:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492684928 00000100:00100000:0.0:1783141851.592809:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:0.0:1783141851.592821:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:10288:x1869759492684928:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1783141851.593119:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:10288:x1869759492684928:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 299us (500us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1783141851.593127:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00010000:00010000:0.0:1783141851.872827:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141851.897628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141851.898302:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492685184 00000100:00100000:3.0:1783141851.898316:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492685184 00000100:00100000:3.0:1783141851.898414:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:3.0:1783141851.898427:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:10320:x1869759492685184:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:3.0:1783141851.898492:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141851.898519:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898a99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe2c expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.898883:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.898902:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.898986:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141851.899001:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783141851.899191:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898a99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe2c expref: 37 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.899219:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe2c expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141851.899244:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:3.0:1783141851.899248:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141851.899252:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2042600, rc 0) 00000100:00100000:3.0:1783141851.899553:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:10320:x1869759492685184:12345-192.168.203.27@tcp:101:cat.0 Request processed in 1126us (1936us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1783141851.899562:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:3.0:1783141851.904053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141851.904222:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492685312 00000100:00100000:2.0:1783141851.904236:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492685312 00000100:00100000:2.0:1783141851.904331:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:2.0:1783141851.904344:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:2368:x1869759492685312:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141851.904365:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141851.904407:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe2c expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141851.904435:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:2.0:1783141851.904442:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141851.904555:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:2368:x1869759492685312:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 213us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141851.904563:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:2.0:1783141851.906894:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141851.907043:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492685568 00000100:00100000:0.0:1783141851.907055:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492685568 00000100:00100000:0.0:1783141851.907122:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:0.0:1783141851.907135:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:10320:x1869759492685568:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:0.0:1783141851.907573:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:10320:x1869759492685568:12345-192.168.203.27@tcp:35:cat.0 Request processed in 439us (688us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1783141851.907598:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:1.0:1783141851.992026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141851.992135:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492685824 00000100:00100000:0.0:1783141851.992149:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492685824 00000100:00100000:0.0:1783141851.992221:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:0.0:1783141851.992233:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:10326:x1869759492685824:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:0.0:1783141851.992269:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141851.992273:0:7171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783141851.992308:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe02 expref: 36 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.992333:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141851.992338:0:7171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141851.992354:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898aae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe33 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.992550:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.992567:0:7171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe25 expref: 36 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.992577:0:7171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.992614:0:7171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe25 expref: 36 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141851.992628:0:7171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe25 expref: 36 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141851.992661:0:7171:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7171:1869759510540672:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141851.992777:0:7171:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489114840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141851.998452:0:7171:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7171:1869759510540672:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141851.998526:0:7171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141851.998652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141852.000204:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492685952 00000100:00100000:1.0:1783141852.000221:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492685952 00010000:00010000:1.0:1783141852.000445:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe25 expref: 37 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141852.000560:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:1.0:1783141852.000573:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+37:2369:x1869759492685952:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141852.000593:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141852.000601:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe25 expref: 37 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.000616:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe25 expref: 37 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.000648:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da898a84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe25 expref: 37 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.000669:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:1.0:1783141852.000693:0:7493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.000704:0:7493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.000712:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.000762:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141852.000843:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:2369:x1869759492685952:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 271us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141852.000851:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00010000:00010000:3.0:1783141852.000919:0:7171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.000928:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141852.000953:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783141852.001170:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898aae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe33 expref: 37 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.001188:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe33 expref: 36 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.001195:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:3.0:1783141852.001198:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141852.001200:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7400, rc 0) 00000100:00100000:3.0:1783141852.001232:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:10326:x1869759492685824:12345-192.168.203.27@tcp:101:dd.0 Request processed in 9002us (9223us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783141852.001240:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00080000:2.0:1783141852.006795:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141852.013168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.013420:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492686208 00000100:00100000:0.0:1783141852.013434:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492686208 00000100:00100000:0.0:1783141852.013535:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:0.0:1783141852.013548:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:10326:x1869759492686208:12345-192.168.203.27@tcp:36:dd.0 00010000:00010000:0.0:1783141852.014069:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.014090:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.014103:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141852.014168:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1783141852.014195:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061c341a4 reply state 00000000626b450d transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141852.014205:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141852.014395:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:10326:x1869759492686208:12345-192.168.203.27@tcp:36:dd.0 Request processed in 840us (1240us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1783141852.014404:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00000020:00080000:0.0:1783141852.014430:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783141852.023956:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.023979:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.023989:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.023996:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141852.024002:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.024011:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.024034:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:1.0:1783141852.024037:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141852.024043:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.024074:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898ac3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141852.186922:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510541184:0@lo:400:kworker.0 00000100:00100000:1.0:1783141852.187017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141852.187101:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783141852.187107:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510540800:0@lo:400:kworker.0 00000100:00100000:1.0:1783141852.187140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141852.187167:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510541312:0@lo:400:kworker.0 00000100:00100000:1.0:1783141852.187196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141852.187231:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510541184 00000100:00100000:1.0:1783141852.187242:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510541184 00000100:00100000:1.0:1783141852.187306:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783141852.187317:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1869759510541184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141852.187395:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1869759510541184:12345-0@lo:400:kworker.0 Request processed in 67us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141852.187404:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783141852.187431:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510540800 00000100:00100000:1.0:1783141852.187435:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510540800 00000100:00100000:1.0:1783141852.187458:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783141852.187488:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510540800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141852.187518:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510540800:12345-0@lo:400:kworker.0 Request processed in 31us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141852.187525:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783141852.187575:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510540800:0@lo:400:kworker.0 00000100:00100000:1.0:1783141852.187614:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510541184:0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.187732:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510541056:0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.187767:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141852.187793:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783141852.187800:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510540928:0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.187824:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141852.187843:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510541440:0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.187866:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141852.187890:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510541440 00000100:00100000:3.0:1783141852.187894:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510541440 00000100:00100000:3.0:1783141852.187930:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783141852.187938:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510541440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.187978:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510541440:12345-0@lo:400:kworker.0 Request processed in 41us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141852.187985:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783141852.188011:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510541440:0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.188030:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510541312 00000100:00100000:3.0:1783141852.188033:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510541312 00000100:00100000:3.0:1783141852.188057:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510541056 00000100:00100000:3.0:1783141852.188059:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510541056 00000100:00100000:3.0:1783141852.188074:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510540928 00000100:00100000:3.0:1783141852.188077:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510540928 00000100:00100000:3.0:1783141852.188088:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783141852.188093:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510541312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.188126:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510541312:12345-0@lo:400:kworker.0 Request processed in 32us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141852.188132:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783141852.188141:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783141852.188154:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510541056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.188185:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510541056:12345-0@lo:400:kworker.0 Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141852.188191:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783141852.188210:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783141852.188215:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510540928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.188241:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510540928:12345-0@lo:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141852.188246:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783141852.188269:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510540928:0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.188279:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510541056:0@lo:400:kworker.0 00000100:00080000:2.0:1783141852.188431:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141852.188444:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141852.189965:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510541312:0@lo:400:kworker.0 00000100:00100000:3.0:1783141852.190088:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510541568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141852.190160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141852.190512:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510541568 00000100:00100000:1.0:1783141852.190520:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510541568 00000100:00100000:1.0:1783141852.190580:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783141852.190591:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869759510541568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783141852.190622:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141852.190679:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1869759510541568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141852.190687:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783141852.191568:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510541568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141852.308952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141852.309116:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492686336 00000100:00100000:3.0:1783141852.309129:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492686336 00000100:00100000:3.0:1783141852.309209:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:3.0:1783141852.309220:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:10340:x1869759492686336:12345-192.168.203.27@tcp:101:stat.0 00010000:00010000:3.0:1783141852.309252:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141852.309278:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898aca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe3a expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309376:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309427:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309440:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309496:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309505:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309513:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309636:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309648:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe33 expref: 39 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309656:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309697:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe33 expref: 39 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.309712:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe33 expref: 39 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141852.309740:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510541696:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141852.309875:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff946383c64000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141852.312936:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510541696:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141852.312987:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141852.313755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.314014:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492686592 00000100:00100000:0.0:1783141852.314027:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492686592 00000100:00100000:0.0:1783141852.314101:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:0.0:1783141852.314113:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:5578:x1869759492686592:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783141852.315683:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:5578:x1869759492686592:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 717us (1077us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1783141852.315699:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1783141852.326344:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141852.326676:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492686720 00000100:00100000:3.0:1783141852.326690:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492686720 00010000:00010000:3.0:1783141852.326810:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe33 expref: 41 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141852.326857:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:3.0:1783141852.326870:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:2369:x1869759492686720:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141852.326892:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141852.326901:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe33 expref: 41 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.326917:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe33 expref: 41 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.326946:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898ab5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe33 expref: 41 pid: 7171 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.326967:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:3.0:1783141852.326974:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.327003:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.327012:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.327115:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141852.327192:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:2369:x1869759492686720:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 323us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141852.327201:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00010000:00010000:0.0:1783141852.327859:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.327871:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141852.327936:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783141852.327942:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141852.327994:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328010:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328023:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328031:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328038:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328044:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2042a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.328062:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328070:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328084:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141852.328098:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.328103:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328109:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898ad1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328126:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328132:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328138:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328144:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2042600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.328147:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328153:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328162:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff946489eed400) 00010000:00010000:0.0:1783141852.328164:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.328174:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328180:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898ad8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328227:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898aca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe3a expref: 40 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328243:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe3a expref: 39 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.328250:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141852.328253:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141852.328256:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2043600, rc 0) 00000100:00100000:0.0:1783141852.328367:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:10340:x1869759492686336:12345-192.168.203.27@tcp:101:stat.0 Request processed in 19148us (19635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141852.328376:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:2.0:1783141852.386243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141852.386305:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141852.386354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141852.386406:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492686848 00000100:00100000:3.0:1783141852.386420:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492686848 00000100:00100000:0.0:1783141852.391332:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492687104 00000100:00100000:0.0:1783141852.391352:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492687104 00000100:00100000:0.0:1783141852.392317:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:0.0:1783141852.392333:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492687104:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141852.392457:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2366:x1869759492687104:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 126us (6110us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141852.392488:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:0.0:1783141852.392631:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492686976 00000100:00100000:0.0:1783141852.392638:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492686976 00000100:00100000:0.0:1783141852.392676:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:0.0:1783141852.392683:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2366:x1869759492686976:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141852.392770:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2366:x1869759492686976:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 86us (6540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141852.392777:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00080000:2.0:1783141852.394427:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141852.394440:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141852.396513:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 285 00000100:00100000:1.0:1783141852.396551:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2366:x1869759492686848:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141852.396672:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2366:x1869759492686848:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 144us (10364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141852.396681:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 285 00000100:00100000:2.0:1783141852.416120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.416432:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492687360 00000100:00100000:0.0:1783141852.416446:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492687360 00000100:00100000:0.0:1783141852.416607:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:0.0:1783141852.416620:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:10346:x1869759492687360:12345-192.168.203.27@tcp:36:truncate.0 00010000:00010000:0.0:1783141852.416711:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141852.416749:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe3a expref: 39 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.416776:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141852.416782:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141852.417067:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.417086:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.417097:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141852.417175:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1783141852.417212:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008d61f0a6 reply state 00000000183d40e3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141852.417223:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141852.417408:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:10346:x1869759492687360:12345-192.168.203.27@tcp:36:truncate.0 Request processed in 788us (1308us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1783141852.417417:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 54 00000020:00080000:0.0:1783141852.417424:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783141852.423044:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.423091:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.423100:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.423108:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.423114:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.423123:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.423148:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141852.424046:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.424056:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.424065:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898ae6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141852.552077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.552210:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492687488 00000100:00100000:0.0:1783141852.552223:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492687488 00000100:00100000:0.0:1783141852.552297:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:0.0:1783141852.552308:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:10360:x1869759492687488:12345-192.168.203.27@tcp:101:stat.0 00010000:00010000:0.0:1783141852.552339:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141852.552367:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898aed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe41 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552493:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552527:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552541:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552569:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552577:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552583:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552701:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552710:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552717:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141852.552759:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1783141852.552764:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141852.552787:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552800:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552821:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552827:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552834:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552841:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.552847:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552855:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552870:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141852.552874:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.552879:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552886:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898af4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552903:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552909:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552914:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552925:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.552928:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552933:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552942:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648a1ad600) 00010000:00010000:0.0:1783141852.552944:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.552946:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552952:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898afb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.552988:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898aed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe41 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.553003:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe41 expref: 41 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.553010:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141852.553012:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141852.553015:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6800, rc 0) 00000100:00100000:0.0:1783141852.553098:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:10360:x1869759492687488:12345-192.168.203.27@tcp:101:stat.0 Request processed in 790us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141852.553107:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:3.0:1783141852.660847:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141852.660992:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492687744 00000100:00100000:1.0:1783141852.661006:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492687744 00000100:00100000:1.0:1783141852.661080:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:1.0:1783141852.661093:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:10370:x1869759492687744:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1783141852.661122:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141852.661147:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898b09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe48 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141852.661332:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783141852.661548:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898b09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe48 expref: 43 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.661568:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141852.661572:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783141852.661579:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898b09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe48 expref: 43 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.661597:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52600, rc 0) 00000100:00100000:1.0:1783141852.661682:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:10370:x1869759492687744:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 592us (849us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1783141852.661690:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:2.0:1783141852.665908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141852.666278:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492688000 00000100:00100000:1.0:1783141852.666392:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492688000 00000100:00100000:1.0:1783141852.666501:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:1.0:1783141852.666516:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:10370:x1869759492688000:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1783141852.667007:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+43:10370:x1869759492688000:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 493us (1113us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1783141852.667017:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:2.0:1783141852.701399:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510541824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141852.701554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141852.701712:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510541824 00000100:00100000:0.0:1783141852.701742:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510541824 00000100:00100000:0.0:1783141852.701809:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783141852.701822:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510541824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141852.701870:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141852.701992:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510541824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141852.702001:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783141852.707299:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464b9d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510541824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141852.747367:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.753077:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492688256 00000100:00100000:0.0:1783141852.753099:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492688256 00000100:00100000:0.0:1783141852.753349:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:0.0:1783141852.753362:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+43:10376:x1869759492688256:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1783141852.753406:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141852.753437:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe4f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.754780:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.754808:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe41 expref: 44 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.754817:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.754871:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe41 expref: 44 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.754890:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe41 expref: 44 pid: 5787 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141852.754930:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510541952:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141852.756539:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489197000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141852.764930:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141852.765079:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492688384 00000100:00100000:2.0:1783141852.765093:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492688384 00010000:00010000:2.0:1783141852.765162:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe41 expref: 45 pid: 5787 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141852.765209:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:2.0:1783141852.765220:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+45:2366:x1869759492688384:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141852.765239:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141852.765247:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe41 expref: 45 pid: 5787 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141852.765292:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe41 expref: 45 pid: 5787 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141852.765321:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:2.0:1783141852.765327:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141852.765339:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141852.765348:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141852.765374:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141852.765491:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+45:2366:x1869759492688384:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 243us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141852.765500:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 40 00010000:00010000:0.0:1783141852.766060:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe41 expref: 44 pid: 5787 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141852.766084:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510541952:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141852.766112:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.766123:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.766140:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141852.766166:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1783141852.766726:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe4f expref: 45 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.766747:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe4f expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.766756:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141852.766760:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783141852.766762:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6a00, rc 0) 00000100:00100000:0.0:1783141852.766830:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+44:10376:x1869759492688256:12345-192.168.203.27@tcp:101:bash.0 Request processed in 13470us (19478us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1783141852.766854:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:3.0:1783141852.772029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.772143:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492688640 00000100:00100000:0.0:1783141852.772157:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492688640 00000100:00100000:0.0:1783141852.772236:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:0.0:1783141852.772248:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+44:10376:x1869759492688640:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:0.0:1783141852.772816:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.772838:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.772852:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141852.772906:0:7171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1783141852.772930:0:7171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000818f4d4d reply state 000000003949e15d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141852.772939:0:7171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141852.773046:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+47:10376:x1869759492688640:12345-192.168.203.27@tcp:36:bash.0 Request processed in 797us (1029us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1783141852.773053:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 58 00000020:00080000:0.0:1783141852.773059:0:7171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783141852.777208:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.777232:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.777265:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.777272:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141852.777278:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.777287:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.777309:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:1.0:1783141852.777313:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141852.777318:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.777326:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141852.781871:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.782320:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492688768 00000100:00100000:0.0:1783141852.782334:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492688768 00000100:00100000:0.0:1783141852.782423:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:0.0:1783141852.782437:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+46:10376:x1869759492688768:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1783141852.782519:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141852.782565:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe56 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.782677:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.782693:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe4f expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.782702:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.782741:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe4f expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.782755:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe4f expref: 47 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141852.782771:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510542080:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141852.782868:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489197cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141852.789930:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485191880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510542080:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141852.789963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00010000:00010000:0.0:1783141852.789975:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141852.795509:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492688896 00000100:00100000:1.0:1783141852.795531:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492688896 00010000:00010000:1.0:1783141852.795950:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe4f expref: 48 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141852.796092:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:1.0:1783141852.796108:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+48:2368:x1869759492688896:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141852.796129:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141852.796138:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe4f expref: 48 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.796192:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe4f expref: 48 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.796223:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe4f expref: 48 pid: 5786 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.796245:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:1.0:1783141852.796251:0:7493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.796262:0:7493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.796271:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141852.796309:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141852.796402:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+47:2368:x1869759492688896:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 298us (6442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141852.797563:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 41 00010000:00010000:0.0:1783141852.797789:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.797803:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141852.797904:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783141852.797910:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141852.797939:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.797983:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe56 expref: 47 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.798005:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe56 expref: 46 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.798014:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141852.798018:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141852.798021:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7a00, rc 0) 00000100:00100000:0.0:1783141852.798102:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+46:10376:x1869759492688768:12345-192.168.203.27@tcp:101:bash.0 Request processed in 15667us (16246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141852.798111:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:2.0:1783141852.801730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.804581:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492689152 00000100:00100000:0.0:1783141852.804601:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492689152 00000100:00100000:0.0:1783141852.804689:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:0.0:1783141852.804701:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+46:10376:x1869759492689152:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:0.0:1783141852.805090:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+47:10376:x1869759492689152:12345-192.168.203.27@tcp:35:bash.0 Request processed in 389us (3371us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1783141852.805098:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00010000:00010000:0.0:1783141852.891555:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141852.906695:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.906869:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492689408 00000100:00100000:0.0:1783141852.906898:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492689408 00000100:00100000:0.0:1783141852.906982:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:0.0:1783141852.906995:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+47:10386:x1869759492689408:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141852.907028:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141852.907057:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe5d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141852.907218:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783141852.907364:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe5d expref: 49 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.907393:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141852.907397:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141852.907403:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe5d expref: 49 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.907419:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6c00, rc 0) 00000100:00100000:0.0:1783141852.907571:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+48:10386:x1869759492689408:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 578us (890us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1783141852.907579:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:2.0:1783141852.916529:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.916952:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492689536 00000100:00100000:0.0:1783141852.916965:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492689536 00000100:00100000:0.0:1783141852.917040:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:0.0:1783141852.917051:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+48:10386:x1869759492689536:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:0.0:1783141852.917154:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917175:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917206:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917227:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917235:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917241:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917369:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917390:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917398:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141852.917451:0:7171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917517:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917525:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917541:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917562:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.917567:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917576:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917590:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141852.917594:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.917600:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917606:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917620:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917626:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917633:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917638:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.917641:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917647:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917666:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648a1ad600) 00010000:00010000:0.0:1783141852.917668:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.917671:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917677:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917693:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917700:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917706:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917711:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.917714:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917720:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917727:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141852.917730:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.917733:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.917739:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141852.917841:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+48:10386:x1869759492689536:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 790us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141852.917850:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:2.0:1783141852.921054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141852.921171:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492689792 00000100:00100000:1.0:1783141852.921184:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492689792 00000100:00100000:1.0:1783141852.921253:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:1.0:1783141852.921265:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+48:10386:x1869759492689792:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1783141852.921652:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+49:10386:x1869759492689792:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 388us (611us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1783141852.921661:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:1.0:1783141852.967796:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.967922:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492690048 00000100:00100000:0.0:1783141852.967934:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492690048 00000100:00100000:0.0:1783141852.968006:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:0.0:1783141852.968018:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+49:10389:x1869759492690048:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141852.968061:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141852.968090:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe64 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968193:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968209:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968222:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968240:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968247:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968254:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968516:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968526:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968534:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141852.968544:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783141852.968669:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968678:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968685:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968691:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.968696:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968704:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968718:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141852.968721:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.968726:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968743:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898b6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968760:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968765:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968771:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968776:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.968779:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968786:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968794:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648a1ad600) 00010000:00010000:0.0:1783141852.968796:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141852.968799:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968806:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968852:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe64 expref: 52 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968865:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe64 expref: 51 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.968879:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141852.968881:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141852.968883:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7400, rc 0) 00000100:00100000:0.0:1783141852.968956:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+51:10389:x1869759492690048:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 939us (1173us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1783141852.968964:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:2.0:1783141852.973775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141852.974003:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492690176 00000100:00100000:3.0:1783141852.974016:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492690176 00000100:00100000:3.0:1783141852.974095:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:3.0:1783141852.974107:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+51:2367:x1869759492690176:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141852.974139:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141852.974172:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898b79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe64 expref: 51 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141852.974194:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:3.0:1783141852.974200:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141852.974298:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+50:2367:x1869759492690176:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 192us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141852.974308:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:2.0:1783141852.978255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.978412:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492690304 00000100:00100000:0.0:1783141852.978425:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492690304 00000100:00100000:0.0:1783141852.978691:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:0.0:1783141852.978701:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+50:10389:x1869759492690304:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1783141852.978790:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.978809:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.978820:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.978855:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.978862:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.978870:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.978876:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141852.978898:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.978961:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.978977:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141852.978981:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141852.978987:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141852.978993:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141852.979144:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+50:10389:x1869759492690304:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 442us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141852.979154:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:1.0:1783141852.988347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141852.989585:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492690560 00000100:00100000:0.0:1783141852.989601:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492690560 00000100:00100000:0.0:1783141852.989688:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:0.0:1783141852.989701:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+50:10389:x1869759492690560:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1783141852.990021:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+51:10389:x1869759492690560:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 323us (1689us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783141852.990040:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1783141853.127277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141853.127508:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492690816 00000100:00100000:0.0:1783141853.127522:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492690816 00000100:00100000:0.0:1783141853.127607:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:0.0:1783141853.127619:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+51:10407:x1869759492690816:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:0.0:1783141853.127651:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141853.127883:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe6b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.128152:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.128171:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.128186:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141853.128202:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783141853.128746:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898b8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe6b expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.128772:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe6b expref: 53 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.128782:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:0.0:1783141853.128785:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783141853.128790:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6c00, rc 0) 00000100:00100000:1.0:1783141853.130864:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10407:x1869759492690816:12345-192.168.203.27@tcp:101:cat.0 Request processed in 3233us (3589us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1783141853.130879:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:3.0:1783141853.174397:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.174541:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492690944 00000100:00100000:1.0:1783141853.174554:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492690944 00000100:00100000:1.0:1783141853.174635:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:1.0:1783141853.174647:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10408:x1869759492690944:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1783141853.174689:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141853.174719:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898ba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe72 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.174809:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898baa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.174826:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.174839:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141853.174925:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1783141853.174931:0:10143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141853.174961:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.174996:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898ba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe72 expref: 55 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.175044:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe72 expref: 54 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.175054:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:1.0:1783141853.175058:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141853.175061:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53000, rc 0) 00000100:00100000:1.0:1783141853.175142:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10408:x1869759492690944:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 496us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141853.175151:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:2.0:1783141853.183193:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141853.183578:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492691328 00000100:00100000:0.0:1783141853.183592:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492691328 00000100:00100000:0.0:1783141853.183679:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:0.0:1783141853.183692:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10408:x1869759492691328:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1783141853.184122:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10408:x1869759492691328:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 432us (943us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1783141853.184131:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:2.0:1783141853.186696:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141853.186787:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492691456 00000100:00100000:3.0:1783141853.186799:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492691456 00000100:00100000:3.0:1783141853.186872:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:3.0:1783141853.186882:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10408:x1869759492691456:12345-192.168.203.27@tcp:103:lfs.0 00010000:00010000:3.0:1783141853.186900:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783141853.186936:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898b3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe56 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.186964:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898b95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe6b expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.186977:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898a45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe17 expref: 53 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.186988:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1adf00) 00010000:00010000:3.0:1783141853.187001:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141853.187077:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:10408:x1869759492691456:12345-192.168.203.27@tcp:103:lfs.0 Request processed in 195us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141853.187085:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:3.0:1783141853.189560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141853.189650:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492691584 00000100:00100000:0.0:1783141853.189661:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492691584 00000100:00100000:0.0:1783141853.189731:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:0.0:1783141853.189742:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:10408:x1869759492691584:12345-192.168.203.27@tcp:58:lfs.0 00010000:00010000:0.0:1783141853.189905:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.189926:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.189939:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783141853.190296:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141853.190569:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1783141853.190660:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1783141853.190789:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:10408:x1869759492691584:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 1045us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141853.190800:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:2.0:1783141853.215727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141853.216613:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492691712 00000100:00100000:3.0:1783141853.216630:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492691712 00000100:00100000:3.0:1783141853.216694:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:3.0:1783141853.216704:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:10410:x1869759492691712:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141853.216844:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141853.216908:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898bb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe79 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217026:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217044:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217057:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217075:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217082:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217090:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217234:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217244:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217250:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141853.217294:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783141853.217299:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141853.217321:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217345:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217356:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217363:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217370:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217387:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141853.217392:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217401:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217417:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:2.0:1783141853.217420:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141853.217425:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217432:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217446:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217453:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217506:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217512:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141853.217516:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217524:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217787:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648c722e00) 00010000:00010000:2.0:1783141853.217791:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141853.217795:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217802:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898bc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217846:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898bb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe79 expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217861:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe79 expref: 53 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.217868:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1ad600) 00010000:00010000:2.0:1783141853.217870:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141853.217873:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1c00, rc 0) 00000100:00100000:2.0:1783141853.217968:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10410:x1869759492691712:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1263us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141853.217987:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 67 00000040:00080000:1.0:1783141853.406813:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141853.406827:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141853.406893:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783141853.406903:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141853.407077:0:11546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510542208:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783141853.407267:0:11546:0:(client.c:2701:ptlrpc_set_wait()) set ffff946481370f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141853.415704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141853.415987:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492691840 00000100:00100000:3.0:1783141853.415997:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492691840 00000100:00100000:1.0:1783141853.415997:0:11546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510542208:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783141853.416139:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:3.0:1783141853.416221:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10421:x1869759492691840:12345-192.168.203.27@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783141853.416322:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10421:x1869759492691840:12345-192.168.203.27@tcp:900:lhsmtool_posix.0 Request processed in 105us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141853.416331:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:2.0:1783141853.419621:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.419711:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492691968 00000100:00100000:1.0:1783141853.419724:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492691968 00000100:00100000:1.0:1783141853.419940:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:1.0:1783141853.419955:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10421:x1869759492691968:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783141853.419999:0:10143:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783141853.420215:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10421:x1869759492691968:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 263us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141853.420226:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:2.0:1783141853.434144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.434221:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492692096 00000100:00100000:1.0:1783141853.434234:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492692096 00000100:00100000:1.0:1783141853.434316:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:1.0:1783141853.434329:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10421:x1869759492692096:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783141853.434436:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434457:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434504:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434726:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434748:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434761:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434798:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434807:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434814:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141853.434856:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783141853.434873:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141853.434888:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434901:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434907:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434914:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434920:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141853.434924:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434932:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434946:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:1.0:1783141853.434949:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141853.434955:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434961:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898bd4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434977:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.434983:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435004:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435010:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141853.435013:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435019:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435027:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff94648becaa00) 00010000:00010000:1.0:1783141853.435030:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141853.435033:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435039:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898bdb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435055:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435061:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435067:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435072:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141853.435075:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435093:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435102:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1ad600) 00010000:00010000:1.0:1783141853.435105:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141853.435108:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.435114:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898be2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141853.435364:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10421:x1869759492692096:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 1032us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141853.435387:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:2.0:1783141853.444811:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141853.444922:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492692352 00000100:00100000:3.0:1783141853.444932:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492692352 00000100:00100000:3.0:1783141853.444992:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:3.0:1783141853.445002:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10421:x1869759492692352:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141853.445021:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141853.445039:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898be9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe80 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445145:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445159:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445183:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141853.445195:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783141853.445285:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445302:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445308:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445313:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2043400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141853.445317:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445324:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445336:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1ad600) 00010000:00010000:3.0:1783141853.445339:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141853.445344:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445351:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898bf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445398:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898be9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe80 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445409:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:3.0:1783141853.445411:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141853.445415:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898be9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe80 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.445426:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2042600, rc 0) 00000100:00100000:3.0:1783141853.445505:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10421:x1869759492692352:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 504us (703us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1783141853.445512:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:2.0:1783141853.451808:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141853.451943:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492692480 00000100:00100000:0.0:1783141853.451953:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492692480 00000100:00100000:0.0:1783141853.452006:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:0.0:1783141853.452016:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10421:x1869759492692480:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783141853.452051:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783141853.452154:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10421:x1869759492692480:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 138us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141853.452162:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:0.0:1783141853.464280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141853.464446:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492692736 00000100:00100000:3.0:1783141853.464455:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492692736 00000100:00100000:3.0:1783141853.464536:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:3.0:1783141853.464546:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10421:x1869759492692736:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141853.464565:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141853.464569:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783141853.464599:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898baa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe72 expref: 54 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.464619:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:3.0:1783141853.464625:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141853.464637:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898bfe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783141853.469452:0:5788:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1783141853.469687:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.469703:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.469715:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.469777:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898bfe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe87 expref: 56 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.469797:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe87 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.469805:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648c722e00) 00010000:00010000:2.0:1783141853.469808:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141853.469811:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0200, rc 0) 00000100:00100000:2.0:1783141853.469888:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10421:x1869759492692736:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 5343us (5615us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1783141853.469898:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:2.0:1783141853.473869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141853.473940:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492692992 00000100:00100000:0.0:1783141853.473954:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492692992 00000100:00100000:0.0:1783141853.474009:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:0.0:1783141853.474019:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10421:x1869759492692992:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141853.474077:0:10143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141853.474104:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898c05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe87 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474120:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648c722e00) 00010000:00010000:0.0:1783141853.474130:0:10143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141853.474150:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474163:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474172:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474185:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474193:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474199:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474269:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474288:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474302:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474308:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141853.474313:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474321:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474330:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141853.474333:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141853.474336:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474342:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898c13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474352:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474358:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474364:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474369:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141853.474372:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474398:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474407:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6f75f4a (ffff94648a1adb00) 00010000:00010000:0.0:1783141853.474409:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141853.474412:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.474418:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898c1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6f75f4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141853.474518:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10421:x1869759492692992:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 500us (657us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141853.474525:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:2.0:1783141853.483790:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.491879:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492693120 00000100:00100000:1.0:1783141853.491893:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492693120 00000100:00100000:1.0:1783141853.492219:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:1.0:1783141853.492230:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10421:x1869759492693120:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141853.492252:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141853.492286:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898c21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe8e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.492319:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.492332:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.492342:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.492445:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898c21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe8e expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.492601:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe8e expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.492610:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:1.0:1783141853.492613:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783141853.492616:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53600, rc 0) 00000100:00100000:1.0:1783141853.492679:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10421:x1869759492693120:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 452us (8899us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141853.492686:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:3.0:1783141853.501911:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.502107:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492693376 00000100:00100000:2.0:1783141853.502117:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492693376 00000100:00100000:2.0:1783141853.502200:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:2.0:1783141853.502211:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10421:x1869759492693376:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783141853.502313:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.502329:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.502341:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141853.502893:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1783141853.502904:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360707443313ns, next at 361707441443ns, rc = 0 00000004:00010000:2.0:1783141853.502985:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004af16887 reply state 00000000d2dbbf4b transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141853.502995:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141853.503081:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:10421:x1869759492693376:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 871us (1178us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1783141853.503089:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 75 00010000:00010000:3.0:1783141853.512324:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.512341:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.512349:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.512356:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141853.512360:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.512390:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.512407:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:3.0:1783141853.512410:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783141853.512415:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.512421:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141853.517772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.517852:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492693504 00000100:00100000:2.0:1783141853.517862:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492693504 00000100:00100000:2.0:1783141853.517916:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:2.0:1783141853.517927:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:10421:x1869759492693504:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141853.517951:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141853.517985:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe95 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.518045:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe95 expref: 57 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.518059:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe95 expref: 57 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.518080:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:2.0:1783141853.518083:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141853.518087:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1200, rc 0) 00000100:00100000:2.0:1783141853.518149:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:10421:x1869759492693504:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 223us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141853.518156:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:0.0:1783141853.530054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.530148:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492693632 00000100:00100000:2.0:1783141853.530159:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492693632 00000100:00100000:2.0:1783141853.530217:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:2.0:1783141853.530226:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2365:x1869759492693632:12345-192.168.203.27@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1783141853.530258:0:6587:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp t0 exp 0000000000000000 cur 360 last 0 00000020:00000080:2.0:1783141853.530297:0:6587:0:(genops.c:1406:class_connect()) connect: client 8c7e4ac0-9090-4366-bd86-d237f38a8cf1, cookie 0x279ffa91da898c3d 00002000:00100000:2.0:1783141853.530309:0:6587:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8c7e4ac0-9090-4366-bd86-d237f38a8cf1/ffff946489852800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783141853.530321:0:6587:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783141853.530616:0:6587:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783141853.530644:0:6587:0:(import.c:65:import_set_state_nolock()) ffff946489850800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141853.530713:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2365:x1869759492693632:12345-192.168.203.27@tcp:8:lhsmtool_posix.0 Request processed in 486us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141853.530736:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:3.0:1783141853.538736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141853.538849:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492693760 00000100:00100000:0.0:1783141853.538863:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492693760 00000100:00080000:2.0:1783141853.539000:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141853.539053:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:0.0:1783141853.539065:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:0:x1869759492693760:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1783141853.632122:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1783141853.632141:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000100:00100000:3.0:1783141853.633695:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:0:x1869759492693760:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 94619us (94959us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783141853.633713:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:3.0:1783141853.635974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.636050:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492694016 00000100:00100000:1.0:1783141853.636063:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492694016 00000100:00100000:1.0:1783141853.636130:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:1.0:1783141853.636141:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:10421:x1869759492694016:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783141853.636524:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+58:10421:x1869759492694016:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 384us (562us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1783141853.636532:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:2.0:1783141853.652607:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.652933:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492694272 00000100:00100000:1.0:1783141853.652943:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492694272 00000100:00100000:1.0:1783141853.653011:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:1.0:1783141853.653024:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+58:10421:x1869759492694272:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783141853.653162:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+58:10421:x1869759492694272:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 139us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141853.653185:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:3.0:1783141853.655819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.656761:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492694400 00000100:00100000:1.0:1783141853.656773:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492694400 00000100:00100000:1.0:1783141853.656830:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:1.0:1783141853.656841:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+58:10421:x1869759492694400:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141853.656861:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141853.656890:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898c44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fe9c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.656954:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da898c4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.656968:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da898c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.656979:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da898c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141853.657014:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141853.657143:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da898c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.657213:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898c44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe9c expref: 60 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.657356:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da898c4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe9c expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.657391:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:1.0:1783141853.657394:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783141853.657398:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52000, rc 0) 00000100:00100000:1.0:1783141853.657478:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:10421:x1869759492694400:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 618us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141853.657495:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:3.0:1783141853.665831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.665927:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492694528 00000100:00100000:2.0:1783141853.665936:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492694528 00000100:00100000:2.0:1783141853.665993:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:2.0:1783141853.666006:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2368:x1869759492694528:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141853.666028:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141853.666051:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fea3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783141853.666078:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4895dd, blocks: 0x1 00010000:00010000:2.0:1783141853.666217:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1783141853.666222:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141853.666236:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fea3 expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.666258:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fea3 expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.666271:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1400, rc 0) 00000100:00100000:2.0:1783141853.666332:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492694528:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 329us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141853.666340:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:1.0:1783141853.683007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141853.685422:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492694784 00000100:00100000:3.0:1783141853.685435:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492694784 00000100:00100000:3.0:1783141853.685508:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:3.0:1783141853.685526:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:10421:x1869759492694784:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783141853.685623:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:10421:x1869759492694784:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 107us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141853.685630:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:2.0:1783141853.689321:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.690296:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492694912 00000100:00100000:1.0:1783141853.690307:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492694912 00000100:00100000:1.0:1783141853.690361:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:1.0:1783141853.690381:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:10421:x1869759492694912:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141853.690399:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141853.690417:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99feaa expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.690447:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fea3 expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.690602:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141853.690608:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141853.690614:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.690650:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fea3 expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.690676:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fea3 expref: 7 pid: 6587 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141853.690689:0:6586:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6586:1869759510542336:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141853.690784:0:6586:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141853.695648:0:6586:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6586:1869759510542336:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141853.695682:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.695702:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53c00, rc 0) 00000100:00100000:1.0:1783141853.695767:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:10421:x1869759492694912:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 5396us (6453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141853.695776:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:3.0:1783141853.696955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.700445:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492695040 00000100:00100000:1.0:1783141853.700476:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492695040 00010000:00010000:1.0:1783141853.700525:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fea3 expref: 7 pid: 6587 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141853.700562:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:1.0:1783141853.700572:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2368:x1869759492695040:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141853.700587:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141853.700611:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fea3 expref: 7 pid: 6587 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.700640:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fea3 expref: 7 pid: 6587 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.700664:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fea3 expref: 7 pid: 6587 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.700678:0:7493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141853.700683:0:7493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141853.700692:0:7493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.700702:0:7493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.700740:0:7493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141853.700754:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7493:1869759510542464:192.168.203.27@tcp:105: 00000100:00100000:1.0:1783141853.700846:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141853.706263:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7493:1869759510542464:192.168.203.27@tcp:105: 00010000:00010000:3.0:1783141853.706299:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141853.706350:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492695040:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 5779us (9400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141853.706361:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:3.0:1783141853.708639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141853.712482:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492695168 00000100:00100000:0.0:1783141853.712495:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492695168 00002000:00100000:0.0:1783141853.712550:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9464ba8fe300 x1869759492695168/t0(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:229/0 lens 504/0 e 0 to 0 dl 1783141864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141853.712562:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464ba8fe300 with x1869759492695168 ext(0->8) 00002000:00010000:0.0:1783141853.712568:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9464ba8fe300 00000100:00100000:0.0:1783141853.712592:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:3.0:1783141853.712598:0:6591:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783141853.712601:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492695168:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783141853.712606:0:6591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1783141853.713178:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2369:x1869759492695168:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 Request processed in 577us (4546us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783141853.713186:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00002000:00100000:0.0:1783141853.713193:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9464ba8fe300 x1869759492695168/t4294967302(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:229/0 lens 504/448 e 0 to 0 dl 1783141864 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141853.713201:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464ba8fe300 with x1869759492695168 ext(0->8) 00002000:00010000:0.0:1783141853.713204:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9464ba8fe300 00000100:00100000:0.0:1783141853.721486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.721613:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492695296 00000100:00100000:2.0:1783141853.721623:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492695296 00000100:00100000:2.0:1783141853.721678:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:2.0:1783141853.721687:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:10421:x1869759492695296:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1783141853.830291:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:10421:x1869759492695296:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 108588us (108822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141853.830305:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00000001:00080000:3.0:1783141853.831357:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:3.0:1783141853.831402:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1783141853.831427:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1783141853.831450:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1783141853.831487:0:5809:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946489a47240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1783141853.831492:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9464bfca8f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946489ddb780 00000020:00080000:3.0:1783141853.831496:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9464bfca8200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94649d19c800 00000100:00100000:2.0:1783141853.831811:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510542720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783141853.831870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141853.831932:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510542720 00000100:00100000:2.0:1783141853.831939:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510542720 00000100:00100000:2.0:1783141853.831978:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783141853.831986:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510542720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783141853.832128:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783141853.832132:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783141853 00002000:00010000:2.0:1783141853.832134:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783141853.832136:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783141853 -> 1783141853 00002000:00010000:2.0:1783141853.832138:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783141853.832172:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510542720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (302us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783141853.832179:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:2.0:1783141853.832217:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464ba633100/2, rc 0, transno 4294967303 00000100:00100000:2.0:1783141853.832223:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510542720:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1783141853.832319:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1783141853.832426:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1783141853.832440:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510542592:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783141853.832500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141853.832761:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510542592 00000100:00100000:2.0:1783141853.832766:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510542592 00000100:00100000:2.0:1783141853.832812:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783141853.832830:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1869759510542592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783141853.832849:0:10144:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1783141853.832875:0:10144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a4895da, atime: 0x6a4895da, ctime: 0x6a4895da, blocks: 0x1 00010000:00010000:2.0:1783141853.832884:0:10144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.832898:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1783141853.832902:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141853.832908:0:10144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.832924:0:10144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.832934:0:10144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.832941:0:10144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.832956:0:10144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783141853.833414:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1869759510542592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 583us (911us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783141853.833422:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1783141853.837182:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783141853.837200:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141853.837210:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.837224:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141853.837229:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.837259:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.837287:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.837295:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898c60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.837320:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141853.837322:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141853.837324:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783141853.837391:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464ba8ff480/2, rc 0, transno 4294967301 00000100:00100000:3.0:1783141853.837401:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510542592:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783141853.839722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141853.839842:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492695424 00000100:00100000:0.0:1783141853.839850:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492695424 00000100:00100000:0.0:1783141853.839906:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:0.0:1783141853.839916:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2366:x1869759492695424:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783141853.875015:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2366:x1869759492695424:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 35090us (35290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141853.875027:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000001:00080000:0.0:1783141853.875059:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1783141853.875070:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1783141853.878095:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.878162:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492695680 00000100:00100000:1.0:1783141853.878171:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492695680 00000100:00100000:1.0:1783141853.878222:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:1.0:1783141853.878233:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:10421:x1869759492695680:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783141853.878283:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141853.878317:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da898c4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe9c expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.878335:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:1.0:1783141853.878339:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141853.878367:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.878390:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.878399:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141853.878658:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cee68362 reply state 0000000027c9bfb2 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141853.878668:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141853.878750:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:10421:x1869759492695680:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 518us (662us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1783141853.878757:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 81 00010000:00010000:1.0:1783141853.882164:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.882181:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.882188:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.882194:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141853.882198:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.882215:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.882233:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:1.0:1783141853.882236:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141853.882240:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.882247:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141853.883951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.884043:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492695808 00000100:00100000:2.0:1783141853.884053:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492695808 00000100:00100000:2.0:1783141853.884109:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:2.0:1783141853.884129:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492695808:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783141853.884913:0:10144:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783141853.884918:0:10144:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783141853 -> 1783141852 00002000:00010000:2.0:1783141853.884921:0:10144:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783141850 00002000:00010000:2.0:1783141853.884924:0:10144:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783141853 -> 1783141852 00002000:00010000:2.0:1783141853.884926:0:10144:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783141853.884986:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2368:x1869759492695808:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 858us (1043us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783141853.884995:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:0.0:1783141853.889937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141853.890618:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492696064 00000100:00100000:1.0:1783141853.890628:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492696064 00000100:00100000:1.0:1783141853.890724:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:1.0:1783141853.890734:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:10421:x1869759492696064:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783141853.890801:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.890818:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe8e expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.890827:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.890865:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe8e expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.890890:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe8e expref: 13 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141853.890924:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510542848:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141853.891020:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141853.897901:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510542848:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141853.897933:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141853.897982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.898064:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492696192 00000100:00100000:2.0:1783141853.898071:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492696192 00010000:00010000:2.0:1783141853.898108:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe8e expref: 14 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141853.898178:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:2.0:1783141853.898188:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:2369:x1869759492696192:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141853.898202:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141853.898208:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe8e expref: 14 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.898221:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe8e expref: 14 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.898244:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898c28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe8e expref: 14 pid: 5786 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.898287:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:2.0:1783141853.898292:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.898301:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.898308:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.898338:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141853.898397:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:2369:x1869759492696192:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 209us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141853.898405:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00010000:00010000:1.0:1783141853.898638:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.898646:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.898676:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.898683:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.898690:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.898696:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141853.898701:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.898708:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.898718:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:1.0:1783141853.898726:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783141853.898731:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.898737:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898c6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141853.898806:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:10421:x1869759492696064:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 Request processed in 8072us (8878us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783141853.898814:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:3.0:1783141853.901189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.901279:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492696320 00000100:00100000:2.0:1783141853.901289:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492696320 00000100:00100000:2.0:1783141853.901344:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:2.0:1783141853.901354:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2367:x1869759492696320:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783141853.901410:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.901429:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.901437:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783141853.901441:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141853.901445:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.901522:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.901536:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 7 pid: 6586 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141853.901551:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510542976:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141853.901747:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141853.904096:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510542976:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141853.904120:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141853.909143:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.909414:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492696448 00000100:00100000:2.0:1783141853.909424:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492696448 00010000:00010000:2.0:1783141853.909505:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 8 pid: 6586 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141853.909625:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:2.0:1783141853.909637:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2369:x1869759492696448:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141853.909651:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141853.909673:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 8 pid: 6586 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.909687:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 8 pid: 6586 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.909711:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009809444/0x279ffa91da898c59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feaa expref: 8 pid: 6586 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.909741:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141853.909745:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141853.909750:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.909770:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.909806:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141853.909865:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492696448:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 229us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141853.909873:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00010000:00010000:0.0:1783141853.909925:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.909935:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.909960:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.909974:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.909982:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.909988:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1400 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141853.909992:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.910000:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.910013:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.910020:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adee49d3/0x279ffa91da898c75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141853.910067:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492696320:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 8714us (8885us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141853.910075:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00010000:00010000:2.0:1783141853.914679:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141853.920689:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.920844:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492696704 00000100:00100000:2.0:1783141853.920854:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492696704 00000100:00100000:2.0:1783141853.920914:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00100000:2.0:1783141853.920925:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:10421:x1869759492696704:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783141853.920997:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.921014:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.921026:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.921214:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.921236:0:10143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe95 expref: 13 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.921246:0:10143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.921353:0:10143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe95 expref: 13 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.921366:0:10143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe95 expref: 13 pid: 7171 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141853.921389:0:10143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba633800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510543104:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141853.921503:0:10143:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcd540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141853.928121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141853.928204:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492696832 00000100:00100000:3.0:1783141853.928214:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492696832 00010000:00010000:3.0:1783141853.928249:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe95 expref: 14 pid: 7171 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141853.928298:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:3.0:1783141853.928311:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:2369:x1869759492696832:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141853.928326:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141853.928333:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe95 expref: 14 pid: 7171 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.928346:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe95 expref: 14 pid: 7171 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.928367:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:3.0:1783141853.928382:0:7493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.928392:0:7493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.928398:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.928416:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141853.928500:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:2369:x1869759492696832:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 190us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141853.928508:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00010000:00010000:2.0:1783141853.928981:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898c36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe95 expref: 13 pid: 7171 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141853.928999:0:10143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba633800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510543104:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141853.929019:0:10143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.929027:0:10143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.929032:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141853.929213:0:10143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1783141853.929410:0:10143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1783141853.929742:0:10143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1783141853.929845:0:10143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba633800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10143:1869759510543232:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783141853.929899:0:10143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141853.929932:0:10143:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141853.930406:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510543232 00000100:00100000:3.0:1783141853.930419:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510543232 00000100:00100000:3.0:1783141853.930490:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141853.930500:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10143:x1869759510543232:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783141853.930578:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10143:x1869759510543232:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141853.930585:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141853.930621:0:10143:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1783141853.930626:0:10143:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464ba633100, transno 4294967303 00000100:00100000:3.0:1783141853.930638:0:10143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba633800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10143:1869759510543232:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1783141853.931110:0:10143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1783141853.931174:0:10143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba66aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10143:1869759510543360:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783141853.931209:0:10143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141853.931230:0:10143:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464852e3300 going to sleep for 11 seconds 00000100:00100000:3.0:1783141853.931755:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510543360 00000100:00100000:3.0:1783141853.931993:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510543360 00000100:00100000:3.0:1783141853.932023:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141853.932030:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10143:x1869759510543360:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783141853.932205:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10143:x1869759510543360:12345-0@lo:1000:mdt00_004.0 Request processed in 174us (995us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783141853.932212:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141853.932574:0:10143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba66aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10143:1869759510543360:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1783141853.932613:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932623:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932630:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932635:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141853.932640:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932647:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932662:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648becaa00) 00010000:00010000:2.0:1783141853.932665:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141853.932670:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932675:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898c83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932708:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932721:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932726:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932730:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141853.932733:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932740:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932749:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1ad600) 00010000:00010000:2.0:1783141853.932760:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141853.932765:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932771:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898bb1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932791:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932805:0:10143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe79 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932814:0:10143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932842:0:10143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe79 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141853.932862:0:10143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe79 expref: 16 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141853.932875:0:10143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba631880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510543488:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141853.932942:0:10143:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcd540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141853.940735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141853.940881:0:10143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba631880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510543488:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141853.940909:0:10143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141853.940973:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492696960 00000100:00100000:3.0:1783141853.940980:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492696960 00010000:00010000:3.0:1783141853.941014:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe79 expref: 17 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141853.941054:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:3.0:1783141853.941063:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:2369:x1869759492696960:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141853.941083:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141853.941091:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe79 expref: 17 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.941103:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe79 expref: 17 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.941124:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898bcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fe79 expref: 17 pid: 5787 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.941140:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1ad600) 00010000:00010000:3.0:1783141853.941145:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.941155:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.941163:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141853.941193:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141853.941247:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:2369:x1869759492696960:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 184us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141853.941255:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00010000:00010000:1.0:1783141853.941649:0:10143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941658:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941670:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941676:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941682:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941688:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141853.941692:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941699:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941715:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1ad600) 00010000:00010000:1.0:1783141853.941718:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141853.941722:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941728:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898c8a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941739:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941746:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941850:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941857:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141853.941860:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941866:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941874:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1ad600) 00010000:00010000:1.0:1783141853.941877:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783141853.941880:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.941886:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898c7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141853.942249:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:10421:x1869759492696704:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 21324us (21568us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1783141853.942258:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 83 00000020:00080000:1.0:1783141853.942263:0:10143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783141853.944302:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141853.944311:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141853.944346:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783141853.944354:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141853.955479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141853.955646:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492697216 00000100:00100000:0.0:1783141853.955656:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492697216 00000100:00100000:0.0:1783141853.955713:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:0.0:1783141853.955723:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:10421:x1869759492697216:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783141853.956447:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783141853.956603:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1783141853.956650:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.956666:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.956677:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.956685:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.956692:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.956697:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141853.956721:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783141853.956814:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:10421:x1869759492697216:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 1091us (1356us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1783141853.956822:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000020:00080000:0.0:1783141853.956827:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783141853.956834:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141853.956842:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.956852:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141853.956856:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.956865:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.956878:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94648a1adc00) 00010000:00010000:1.0:1783141853.956882:0:7492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783141853.956887:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.956893:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898c91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141853.956909:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141853.956911:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141853.956912:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783141854.070925:0:11866:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141854.070934:0:11866:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141854.070968:0:11866:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783141854.070974:0:11866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783141854.196047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141854.196153:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492697472 00000100:00100000:3.0:1783141854.196173:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492697472 00000100:00100000:3.0:1783141854.196238:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:3.0:1783141854.196248:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:10431:x1869759492697472:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141854.196271:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141854.196292:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898c98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99feb1 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.196572:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898c9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.196587:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.196597:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141854.196608:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1783141854.196781:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898c98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb1 expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.196797:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb1 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.196806:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:3.0:1783141854.196808:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141854.196811:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2042a00, rc 0) 00000100:00100000:3.0:1783141854.196865:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:10431:x1869759492697472:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 619us (836us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1783141854.196872:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00080000:2.0:1783141854.199592:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141854.207428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.207580:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492697600 00000100:00100000:0.0:1783141854.207589:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492697600 00000100:00100000:0.0:1783141854.207757:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:0.0:1783141854.207776:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:10431:x1869759492697600:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:0.0:1783141854.207848:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.207865:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.207877:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.207891:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.207898:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.207903:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208169:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208177:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208185:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141854.208222:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208236:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208249:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208255:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208262:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.208266:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208344:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208359:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141854.208362:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141854.208367:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208383:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208395:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208402:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208409:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208414:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.208424:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208431:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208439:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648a1add00) 00010000:00010000:0.0:1783141854.208527:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141854.208532:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208539:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208555:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208561:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208566:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208571:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.208574:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208580:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208588:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648a1ad500) 00010000:00010000:0.0:1783141854.208590:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141854.208600:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.208673:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898cbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.208759:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:10431:x1869759492697600:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 984us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.208767:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:3.0:1783141854.276646:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141854.276750:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492697856 00000100:00100000:1.0:1783141854.276760:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492697856 00000100:00100000:1.0:1783141854.276863:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:1.0:1783141854.276888:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:10434:x1869759492697856:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1783141854.276911:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141854.276929:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da898cc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99feb8 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277001:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277018:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277029:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277043:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277049:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277056:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277566:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277576:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277583:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141854.277602:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1783141854.277689:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277696:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277703:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277709:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141854.277713:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277720:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277733:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:1.0:1783141854.277736:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141854.277740:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277745:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898cc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277757:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277762:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277836:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277841:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141854.277844:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277850:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277858:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648becab00) 00010000:00010000:1.0:1783141854.277860:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141854.277863:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277869:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898cd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277911:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da898cc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb8 expref: 22 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277924:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb8 expref: 21 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.277932:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:1.0:1783141854.277934:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141854.277937:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53200, rc 0) 00000100:00100000:1.0:1783141854.277994:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:10434:x1869759492697856:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1108us (1357us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1783141854.278011:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:0.0:1783141854.289806:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141854.290159:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492697984 00000100:00100000:3.0:1783141854.290169:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492697984 00000100:00100000:3.0:1783141854.290224:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 87 00000100:00100000:3.0:1783141854.290235:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:10434:x1869759492697984:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:3.0:1783141854.290301:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.290319:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.290331:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.290359:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.290366:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.290383:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.290389:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2043400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141854.290394:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.290401:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.290412:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:3.0:1783141854.290415:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141854.290433:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.290440:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898ce5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.290870:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:10434:x1869759492697984:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 634us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141854.290879:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 87 00000100:00100000:0.0:1783141854.302519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141854.302605:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492698240 00000100:00100000:1.0:1783141854.302615:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492698240 00000100:00100000:1.0:1783141854.302673:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:1.0:1783141854.302683:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:10434:x1869759492698240:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1783141854.302915:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:10434:x1869759492698240:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 232us (405us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1783141854.302923:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:1.0:1783141854.348700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.348795:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492698496 00000100:00100000:0.0:1783141854.348806:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492698496 00000100:00100000:0.0:1783141854.348873:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 88 00000100:00100000:0.0:1783141854.348884:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:9965:x1869759492698496:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1783141854.348907:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141854.348928:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99febf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.349028:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.349042:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb8 expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.349050:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.349085:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb8 expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.349114:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb8 expref: 23 pid: 10143 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.349127:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488316680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510543616:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141854.349220:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141854.355540:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.355792:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488316680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510543616:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141854.355818:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.355925:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492698624 00000100:00100000:3.0:1783141854.355933:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492698624 00010000:00010000:3.0:1783141854.355968:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb8 expref: 24 pid: 10143 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.356008:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:3.0:1783141854.356018:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:2368:x1869759492698624:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141854.356032:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141854.356038:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb8 expref: 24 pid: 10143 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.356050:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb8 expref: 24 pid: 10143 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.356070:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb8 expref: 24 pid: 10143 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.356088:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:3.0:1783141854.356092:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.356117:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.356124:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.356153:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141854.356210:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:2368:x1869759492698624:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 193us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141854.356218:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00010000:00010000:0.0:1783141854.356576:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.356583:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141854.356602:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783141854.356739:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898cec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99febf expref: 24 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.356755:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99febf expref: 23 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.356762:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:0.0:1783141854.356764:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783141854.356766:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7400, rc 0) 00000100:00100000:0.0:1783141854.356968:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:9965:x1869759492698496:12345-192.168.203.27@tcp:101:bash.0 Request processed in 8086us (8277us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1783141854.356986:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 88 00000100:00100000:2.0:1783141854.365307:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141854.365429:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492698880 00000100:00100000:1.0:1783141854.365439:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492698880 00000100:00100000:1.0:1783141854.365515:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 89 00000100:00100000:1.0:1783141854.365525:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:9965:x1869759492698880:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:1.0:1783141854.365775:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.365793:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.365804:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141854.365858:0:10143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1783141854.365884:0:10143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000433b5959 reply state 000000000790af43 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141854.365894:0:10143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783141854.365939:0:10143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1783141854.366055:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:9965:x1869759492698880:12345-192.168.203.27@tcp:36:bash.0 Request processed in 530us (756us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1783141854.366062:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 89 00000020:00080000:1.0:1783141854.366067:0:10143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1783141854.371597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.371673:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492699008 00000100:00100000:0.0:1783141854.371684:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492699008 00000100:00100000:0.0:1783141854.371752:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 90 00000100:00100000:0.0:1783141854.371763:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:9965:x1869759492699008:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141854.371782:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.371789:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141854.371795:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.371804:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.371811:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.371811:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898d08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fec6 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.371818:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.371830:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.371844:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:3.0:1783141854.371847:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141854.371852:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.371875:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898d08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fec6 expref: 28 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.371891:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898d08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fec6 expref: 28 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.371909:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:0.0:1783141854.371912:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141854.371915:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7a00, rc 0) 00010000:00010000:3.0:1783141854.371944:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898d01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.371977:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:9965:x1869759492699008:12345-192.168.203.27@tcp:101:bash.0 Request processed in 216us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.371986:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 90 00000100:00100000:2.0:1783141854.376205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141854.376309:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492699136 00000100:00100000:1.0:1783141854.376319:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492699136 00000100:00100000:1.0:1783141854.376383:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:1.0:1783141854.376394:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:9965:x1869759492699136:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1783141854.376412:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141854.376432:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fecd expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141854.376493:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4895dc, atime: 0x6a4895da, ctime: 0x6a4895dc, blocks: 0xb 00010000:00010000:1.0:1783141854.376517:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1783141854.376522:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141854.376531:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fecd expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.376548:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fecd expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.376560:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52000, rc 0) 00000100:00100000:1.0:1783141854.376619:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:9965:x1869759492699136:12345-192.168.203.27@tcp:101:bash.0 Request processed in 227us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141854.376627:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:2.0:1783141854.384925:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.385506:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492699264 00000100:00100000:0.0:1783141854.385517:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492699264 00002000:00010000:0.0:1783141854.385559:0:6590:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1783141854.385565:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464ba633480 with x1869759492699264 ext(0->18446744073709551615) 00002000:00010000:0.0:1783141854.385577:0:6590:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9464ba633480. 00000100:00100000:0.0:1783141854.385627:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:0.0:1783141854.385639:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492699264:12345-192.168.203.27@tcp:10:bash.0 00002000:00010000:0.0:1783141854.385915:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783141854.385919:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783141852 -> 1783141854 00002000:00010000:0.0:1783141854.385922:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1783141850 -> 1783141850 00002000:00010000:0.0:1783141854.385924:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783141852 -> 1783141854 00002000:00010000:0.0:1783141854.385927:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1783141854.385993:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2369:x1869759492699264:12345-192.168.203.27@tcp:10:bash.0 Request processed in 356us (1078us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783141854.386001:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00002000:00010000:0.0:1783141854.386005:0:6590:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1783141854.386008:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464ba633480 with x1869759492699264 ext(0->18446744073709551615) 00002000:00010000:0.0:1783141854.386012:0:6590:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9464ba633480. 00000100:00100000:3.0:1783141854.462963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.463166:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492699392 00000100:00100000:0.0:1783141854.463380:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492699392 00000100:00100000:0.0:1783141854.463597:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 91 00000100:00100000:0.0:1783141854.463609:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:10448:x1869759492699392:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:0.0:1783141854.463680:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.463698:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.463709:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.463725:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.463749:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.463756:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464251:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464262:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464269:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141854.464389:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464401:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464407:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464413:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464419:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.464422:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464429:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464771:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141854.464776:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141854.464781:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464788:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464801:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464807:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464812:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464817:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.464820:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464826:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464833:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648a1ad500) 00010000:00010000:0.0:1783141854.464835:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141854.464838:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464843:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464869:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464875:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464880:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464885:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.464888:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464893:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464901:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:0.0:1783141854.464903:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141854.464906:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.464912:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.465005:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:10448:x1869759492699392:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 1396us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.465013:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 91 00000100:00100000:1.0:1783141854.545151:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.545249:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492699648 00000100:00100000:0.0:1783141854.545259:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492699648 00000100:00100000:0.0:1783141854.545318:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 92 00000100:00100000:0.0:1783141854.545342:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:10451:x1869759492699648:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141854.545362:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141854.545392:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fed4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.545485:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.545500:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.545513:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.545527:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.545534:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.545540:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.545845:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898d40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.545854:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.545861:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141854.545891:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783141854.546082:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546091:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546098:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546104:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.546108:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546115:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546127:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141854.546130:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141854.546135:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546141:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898d32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546153:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546160:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546176:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546181:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.546184:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546191:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546198:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648a1ad500) 00010000:00010000:0.0:1783141854.546200:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141854.546202:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546207:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546247:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fed4 expref: 30 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546259:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fed4 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.546266:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:0.0:1783141854.546269:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783141854.546271:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7800, rc 0) 00000100:00100000:0.0:1783141854.546333:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:10451:x1869759492699648:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 993us (1191us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1783141854.546350:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 92 00000100:00100000:2.0:1783141854.551002:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141854.551256:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492699776 00000100:00100000:1.0:1783141854.551279:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492699776 00000100:00100000:1.0:1783141854.551395:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 93 00000100:00100000:1.0:1783141854.551406:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:10451:x1869759492699776:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:1.0:1783141854.551508:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.551526:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99febf expref: 29 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.551536:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.551570:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99febf expref: 29 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.551583:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99febf expref: 29 pid: 5788 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141854.551597:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510543744:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141854.551686:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141854.558746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.559410:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492700032 00000100:00100000:0.0:1783141854.559419:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492700032 00000100:00100000:0.0:1783141854.559524:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:0.0:1783141854.559535:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:5578:x1869759492700032:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783141854.560352:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+31:5578:x1869759492700032:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 811us (1606us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1783141854.560362:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:1.0:1783141854.560536:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510543744:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141854.560564:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.563309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141854.563889:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492700160 00000100:00100000:1.0:1783141854.563899:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492700160 00010000:00010000:1.0:1783141854.564014:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99febf expref: 31 pid: 5788 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141854.564109:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:1.0:1783141854.564120:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+31:2368:x1869759492700160:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141854.564135:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141854.564143:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99febf expref: 31 pid: 5788 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.564155:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99febf expref: 31 pid: 5788 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.564176:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898cf3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99febf expref: 31 pid: 5788 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.564192:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:1.0:1783141854.564198:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.564208:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.564216:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.564252:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141854.564319:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:2368:x1869759492700160:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 200us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141854.564326:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 48 00010000:00010000:2.0:1783141854.564404:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.564413:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.564476:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.564484:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.564492:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.564499:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141854.564504:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.564512:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.564521:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:2.0:1783141854.564524:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141854.564527:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.564543:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898d4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.564597:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:10451:x1869759492699776:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 13193us (13605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.564604:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 93 00000100:00100000:3.0:1783141854.568283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141854.568550:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492700416 00000100:00100000:2.0:1783141854.568560:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492700416 00000100:00100000:2.0:1783141854.568604:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1783141854.568618:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:10451:x1869759492700416:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1783141854.568835:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:10451:x1869759492700416:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 217us (559us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1783141854.568843:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:0.0:1783141854.672645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141854.672749:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492700672 00000100:00100000:1.0:1783141854.672772:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492700672 00000100:00100000:1.0:1783141854.672841:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00100000:1.0:1783141854.672852:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:10462:x1869759492700672:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:1.0:1783141854.672875:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141854.672895:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fedb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.672963:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.672977:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.672988:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673001:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673008:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673014:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673327:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898d6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673337:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673344:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141854.673360:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1783141854.673454:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673492:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673499:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673505:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141854.673509:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673517:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673530:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:1.0:1783141854.673533:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141854.673538:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673544:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673558:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673565:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673581:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673587:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141854.673590:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673596:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673604:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648becac00) 00010000:00010000:1.0:1783141854.673607:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141854.673610:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673615:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673659:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fedb expref: 33 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673673:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fedb expref: 32 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.673681:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:1.0:1783141854.673683:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141854.673685:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53400, rc 0) 00000100:00100000:1.0:1783141854.673753:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:10462:x1869759492700672:12345-192.168.203.27@tcp:101:cat.0 Request processed in 902us (1117us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1783141854.673769:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00100000:3.0:1783141854.680362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141854.680660:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492700928 00000100:00100000:2.0:1783141854.680677:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492700928 00000100:00100000:2.0:1783141854.681019:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:2.0:1783141854.681030:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:10462:x1869759492700928:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:2.0:1783141854.681248:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:10462:x1869759492700928:12345-192.168.203.27@tcp:35:cat.0 Request processed in 219us (895us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1783141854.681256:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:3.0:1783141854.702951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141854.703933:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492701184 00000100:00100000:1.0:1783141854.703945:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492701184 00000100:00100000:1.0:1783141854.704006:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 95 00000100:00100000:1.0:1783141854.704016:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:10463:x1869759492701184:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:1.0:1783141854.704074:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783141854.704098:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da898d6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fedb expref: 33 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704119:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898d40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fed4 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704131:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898d08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fec6 expref: 31 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704141:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca600) 00010000:00010000:1.0:1783141854.704150:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141854.704169:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704182:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704191:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704203:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704229:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704236:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704590:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704599:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.704605:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783141854.705360:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1783141854.705382:0:5786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361909921716ns, next at 362909919124ns, rc = 0 00010000:00010000:1.0:1783141854.705436:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705446:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705455:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705482:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705490:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705506:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705518:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141854.705537:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705544:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.705547:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141854.705554:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.705556:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705562:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141854.705569:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.705570:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141854.705577:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705581:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.705590:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705595:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca300) 00010000:00010000:1.0:1783141854.705599:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783141854.705616:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94648beca300) 00010000:00010000:3.0:1783141854.705620:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783141854.705623:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.705630:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898d8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.705643:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141854.705645:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141854.705647:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141854.705686:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705695:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da898d86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705830:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705837:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705849:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705854:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141854.705856:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705862:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705869:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:1.0:1783141854.705871:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141854.705874:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.705880:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da898d78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141854.705890:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001894a2f9 reply state 000000007aed32d7 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141854.705898:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141854.706027:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:10463:x1869759492701184:12345-192.168.203.27@tcp:36:rm.0 Request processed in 2009us (3083us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1783141854.706035:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 95 00010000:00010000:1.0:1783141854.708654:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.708669:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.708695:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.708701:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141854.708705:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.708712:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.708811:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648becac00) 00010000:00010000:1.0:1783141854.708814:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141854.708819:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.708824:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da898d7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.761757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141854.762219:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492701440 00000100:00100000:2.0:1783141854.762230:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492701440 00000100:00100000:2.0:1783141854.762301:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 96 00000100:00100000:2.0:1783141854.762310:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+31:10469:x1869759492701440:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1783141854.762333:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141854.762354:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898d94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fee2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.763127:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.763144:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.763155:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.763187:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.763194:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.763200:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783141854.764112:0:5787:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1783141854.764332:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764346:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764355:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764400:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764408:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764415:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764421:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141854.764425:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764577:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764591:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:2.0:1783141854.764594:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141854.764599:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764605:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898d9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141854.764618:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2f80cd8 reply state 00000000ebed86bd transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.764625:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783141854.764721:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898d94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee2 expref: 34 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764736:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee2 expref: 33 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.764743:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722800) 00010000:00010000:2.0:1783141854.764745:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141854.764747:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1600, rc 0) 00000100:00100000:2.0:1783141854.765028:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:10469:x1869759492701440:12345-192.168.203.27@tcp:101:bash.0 Request processed in 2716us (3277us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783141854.765038:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 96 00010000:00010000:0.0:1783141854.767597:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.767607:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.767612:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.767616:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.767619:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.767624:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.767636:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648c722700) 00010000:00010000:0.0:1783141854.767638:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141854.767641:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.767741:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898da2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.769400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.769492:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492701568 00000100:00100000:0.0:1783141854.769503:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492701568 00000100:00080000:2.0:1783141854.769557:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141854.769571:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:0.0:1783141854.769581:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2366:x1869759492701568:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1783141854.769598:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141854.769617:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fee9 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141854.769643:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783141854.769662:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1783141854.769671:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141854.769681:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee9 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.769699:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee9 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.769712:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6a00, rc 0) 00000100:00100000:0.0:1783141854.769790:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2366:x1869759492701568:12345-192.168.203.27@tcp:101:bash.0 Request processed in 210us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141854.769799:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:3.0:1783141854.774185:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141854.774860:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492701696 00000100:00100000:1.0:1783141854.774870:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492701696 00000100:00100000:1.0:1783141854.774976:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:1.0:1783141854.774986:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:10469:x1869759492701696:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1783141854.775004:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141854.775024:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fef0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.775055:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee9 expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.775080:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141854.775084:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141854.775090:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 9 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.775125:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee9 expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.775137:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee9 expref: 9 pid: 6584 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141854.775151:0:6586:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1869759510543872:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141854.775240:0:6586:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783141854.779699:0:6586:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1869759510543872:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141854.779750:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 9 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.779772:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53000, rc 0) 00000100:00100000:2.0:1783141854.779833:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:10469:x1869759492701696:12345-192.168.203.27@tcp:101:bash.0 Request processed in 4847us (5656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.779841:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:1.0:1783141854.780529:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141854.781839:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492701824 00000100:00100000:2.0:1783141854.781848:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492701824 00010000:00010000:2.0:1783141854.781891:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee9 expref: 9 pid: 6584 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.781943:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:2.0:1783141854.781952:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2368:x1869759492701824:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.781966:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141854.781988:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee9 expref: 9 pid: 6584 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.782002:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee9 expref: 9 pid: 6584 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.782027:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000235f980c/0x279ffa91da898db7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee9 expref: 9 pid: 6584 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.782043:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141854.782059:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141854.782068:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.782077:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.782115:0:5772:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.782129:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba631500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5772:1869759510544000:192.168.203.27@tcp:105: 00000100:00100000:2.0:1783141854.782210:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464969d7780 going to sleep for 11 seconds 00000100:00100000:1.0:1783141854.790791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.790876:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492702080 00000100:00100000:0.0:1783141854.790886:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492702080 00000100:00100000:0.0:1783141854.790965:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:0.0:1783141854.790975:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:10469:x1869759492702080:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:0.0:1783141854.791348:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:10469:x1869759492702080:12345-192.168.203.27@tcp:35:bash.0 Request processed in 373us (565us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1783141854.791357:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:2.0:1783141854.794648:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba631500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5772:1869759510544000:192.168.203.27@tcp:105: 00010000:00010000:2.0:1783141854.794678:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141854.794750:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492701824:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 12797us (14222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.794762:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:1.0:1783141854.932192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141854.932265:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492702208 00000100:00100000:3.0:1783141854.932281:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492702208 00000100:00100000:3.0:1783141854.932334:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 97 00000100:00100000:3.0:1783141854.932344:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:10485:x1869759492702208:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141854.932373:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141854.932391:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898dc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fef7 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.932455:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898dcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.932497:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.932510:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141854.932570:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1783141854.932574:0:7171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783141854.932593:0:7171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.932614:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef7 expref: 36 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.932631:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898dcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef7 expref: 35 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.932656:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:3.0:1783141854.932659:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783141854.932663:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2042600, rc 0) 00000100:00100000:3.0:1783141854.932722:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:10485:x1869759492702208:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 379us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141854.932728:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 97 00010000:00010000:2.0:1783141854.938759:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141854.939222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.939312:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492702464 00000100:00100000:0.0:1783141854.939322:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492702464 00000100:00100000:0.0:1783141854.939383:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 98 00000100:00100000:0.0:1783141854.939393:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:10485:x1869759492702464:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141854.939413:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141854.939432:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898dd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fefe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.939556:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898dda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.939570:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.939581:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141854.939592:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783141854.939718:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da898dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fefe expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.939737:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fefe expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.939760:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722800) 00010000:00010000:0.0:1783141854.939763:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141854.939767:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7800, rc 0) 00000100:00100000:0.0:1783141854.939825:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+37:10485:x1869759492702464:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 433us (609us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1783141854.939833:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 98 00000100:00100000:0.0:1783141854.944281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.944330:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141854.944420:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492702720 00000100:00100000:2.0:1783141854.944430:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492702720 00000100:00100000:2.0:1783141854.944518:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:2.0:1783141854.944527:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+37:10485:x1869759492702720:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141854.944563:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141854.944583:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898de8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff05 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141854.944637:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492702848 00000100:00100000:1.0:1783141854.944643:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492702848 00010000:00010000:2.0:1783141854.944679:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898def lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141854.944688:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1783141854.944699:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:2367:x1869759492702848:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.944708:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898def lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141854.944711:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141854.944726:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898def lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141854.944739:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783141854.944803:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898dda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fefe expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.944860:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898de8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff05 expref: 41 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.944879:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898def lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff05 expref: 40 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.944896:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722800) 00010000:00010000:2.0:1783141854.944901:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783141854.944904:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1c00, rc 0) 00010000:00010000:1.0:1783141854.944914:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722800) 00010000:00010000:1.0:1783141854.944920:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141854.944960:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:10485:x1869759492702720:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 433us (688us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1783141854.944968:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:1.0:1783141854.945006:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:2367:x1869759492702848:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 310us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141854.945015:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:3.0:1783141854.951866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.952667:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492702976 00000100:00100000:0.0:1783141854.952678:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492702976 00000100:00100000:0.0:1783141854.952740:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:0.0:1783141854.952749:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492702976:12345-192.168.203.27@tcp:1:lfs.0 00010000:00010000:0.0:1783141854.952791:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.952810:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.952818:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783141854.952823:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141854.952827:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.952860:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.952893:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 8 pid: 6586 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.952907:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6587:1869759510544128:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141854.953008:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141854.960847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.962697:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6587:1869759510544128:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141854.962784:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.963894:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492703104 00000100:00100000:3.0:1783141854.963912:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492703104 00002000:00100000:3.0:1783141854.963965:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9464ba631f80 x1869759492703104/t0(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:230/0 lens 504/0 e 0 to 0 dl 1783141865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141854.963976:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464ba631f80 with x1869759492703104 ext(0->8) 00010000:00010000:3.0:1783141854.963984:0:6591:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 9 pid: 6586 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.963998:0:6591:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 9 pid: 6586 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141854.964006:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9464ba631f80 00000100:00100000:3.0:1783141854.964050:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:3.0:1783141854.964058:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2369:x1869759492703104:12345-192.168.203.27@tcp:4:lfs.0 00000100:00100000:3.0:1783141854.964616:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:2369:x1869759492703104:12345-192.168.203.27@tcp:4:lfs.0 Request processed in 556us (3776us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783141854.964624:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00002000:00100000:3.0:1783141854.964638:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9464ba631f80 x1869759492703104/t4294967302(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:230/0 lens 504/448 e 0 to 0 dl 1783141865 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141854.964646:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464ba631f80 with x1869759492703104 ext(0->8) 00010000:00010000:3.0:1783141854.964651:0:6591:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 11 pid: 6586 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.964664:0:6591:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 11 pid: 6586 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141854.964671:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9464ba631f80 00000100:00100000:3.0:1783141854.967619:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141854.967893:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492703232 00000100:00100000:2.0:1783141854.967904:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492703232 00010000:00010000:2.0:1783141854.968049:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 11 pid: 6586 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.968094:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:2.0:1783141854.968104:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:2368:x1869759492703232:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.968134:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783141854.968152:0:5774:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783141854.968155:0:5774:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783141854 00002000:00010000:2.0:1783141854.968157:0:5774:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783141854 00002000:00010000:2.0:1783141854.968159:0:5774:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783141854 00010000:00010000:2.0:1783141854.968166:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 11 pid: 6586 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.968179:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 11 pid: 6586 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.968201:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da898dbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef0 expref: 11 pid: 6586 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.968218:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141854.968222:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141854.968227:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.968237:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.968399:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141854.969043:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.969056:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.969081:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.969089:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.969098:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.969118:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141854.969122:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.969131:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.969143:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141854.969151:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082a0232e/0x279ffa91da898dfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.969214:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:2368:x1869759492702976:12345-192.168.203.27@tcp:1:lfs.0 Request processed in 16465us (17355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141854.969223:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:2.0:1783141854.969401:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:2368:x1869759492703232:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 356us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.969411:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:3.0:1783141854.972960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141854.974600:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492703488 00000100:00100000:0.0:1783141854.974613:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492703488 00000100:00100000:0.0:1783141854.974666:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:0.0:1783141854.974677:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:10485:x1869759492703488:12345-192.168.203.27@tcp:35:lfs.0 00000004:00010000:0.0:1783141854.974747:0:5790:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898def lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff05 expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141854.975017:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1783141854.975055:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1783141854.975346:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1783141854.975408:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.975423:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee2 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.975444:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.975505:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee2 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.975518:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee2 expref: 42 pid: 5787 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.975533:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1869759510544256:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141854.975619:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141854.977942:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1869759510544256:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141854.977973:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141854.981286:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141854.981373:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492703616 00000100:00100000:2.0:1783141854.981382:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492703616 00010000:00010000:2.0:1783141854.981422:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee2 expref: 43 pid: 5787 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141854.981612:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:2.0:1783141854.981623:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+43:2369:x1869759492703616:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141854.981639:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141854.981646:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee2 expref: 43 pid: 5787 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.981659:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee2 expref: 43 pid: 5787 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.981679:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898da9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fee2 expref: 43 pid: 5787 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.981706:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722800) 00010000:00010000:2.0:1783141854.981711:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.981720:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.981728:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141854.981747:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141854.981798:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:2369:x1869759492703616:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 175us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141854.981819:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00010000:00010000:0.0:1783141854.981901:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.981920:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141854.982032:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1783141854.982439:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1783141854.982589:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510544384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783141854.982633:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141854.982664:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141854.982695:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510544384 00000100:00100000:3.0:1783141854.982701:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510544384 00000100:00100000:3.0:1783141854.982745:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783141854.982755:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5790:x1869759510544384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783141854.982846:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5790:x1869759510544384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141854.982854:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783141854.983052:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510544384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783141854.983681:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1783141854.983746:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94648bf8f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510544512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783141854.983787:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141854.983814:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141854.983935:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510544512 00000100:00100000:1.0:1783141854.983941:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510544512 00000100:00100000:1.0:1783141854.983981:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783141854.983999:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5790:x1869759510544512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783141854.984168:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5790:x1869759510544512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 179us (379us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783141854.984176:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783141854.985959:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94648bf8f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510544512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783141854.986214:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1783141854.986272:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.986282:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.986288:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.986294:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141854.986298:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.986305:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.986320:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722800) 00010000:00010000:0.0:1783141854.986324:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783141854.986480:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141854.986487:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898e04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141854.987786:0:5790:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783141854.988555:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1783141854.988569:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362193108469ns, next at 363193105645ns, rc = 0 00000001:00080000:0.0:1783141854.988580:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1783141854.988636:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722800) 00010000:00010000:0.0:1783141854.988640:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783141854.988650:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da898def lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff05 expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141854.991307:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+45:10485:x1869759492703488:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 16626us (18349us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1783141854.991320:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 26 00000020:00080000:0.0:1783141854.991333:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783141855.001151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.002936:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492703744 00000100:00100000:2.0:1783141855.002949:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492703744 00000100:00100000:2.0:1783141855.003004:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 100 00000100:00100000:2.0:1783141855.003015:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+45:10485:x1869759492703744:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141855.003037:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141855.003059:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898e0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff0c expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.003116:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898e0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff0c expref: 46 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.003132:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898e0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff0c expref: 46 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.003151:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:2.0:1783141855.003154:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141855.003158:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1600, rc 0) 00000100:00100000:2.0:1783141855.003228:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+46:10485:x1869759492703744:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 214us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141855.003235:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 100 00000040:00080000:1.0:1783141855.003545:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141855.003550:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141855.003580:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783141855.003585:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141855.010457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.010632:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492704000 00000100:00100000:2.0:1783141855.010642:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492704000 00000100:00100000:2.0:1783141855.010736:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:2.0:1783141855.010755:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+46:10485:x1869759492704000:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1783141855.010999:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+47:10485:x1869759492704000:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 253us (550us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1783141855.011018:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:0.0:1783141855.091528:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141855.091613:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492704128 00000100:00100000:1.0:1783141855.091624:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492704128 00000100:00100000:1.0:1783141855.091691:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 101 00000100:00100000:1.0:1783141855.091701:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+47:10495:x1869759492704128:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:1.0:1783141855.091783:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.091800:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.091830:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.091847:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.091854:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.091861:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.091976:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.091985:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092115:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141855.092159:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092171:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092177:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092183:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092201:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141855.092206:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092213:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092225:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:1.0:1783141855.092228:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141855.092233:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092240:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898e12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092254:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092260:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092266:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092271:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141855.092273:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092279:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092417:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648becac00) 00010000:00010000:1.0:1783141855.092421:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141855.092424:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092430:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898e19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092445:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092451:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092457:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092503:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141855.092507:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092513:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092521:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141855.092523:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141855.092526:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.092532:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898e20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141855.092625:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+47:10495:x1869759492704128:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 923us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141855.092634:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 101 00000100:00100000:3.0:1783141855.129837:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141855.132407:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492704384 00000100:00100000:0.0:1783141855.132422:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492704384 00000100:00100000:0.0:1783141855.132521:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 102 00000100:00100000:0.0:1783141855.132532:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+47:10498:x1869759492704384:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141855.132552:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141855.132574:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898e27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff13 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132642:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132657:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132669:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132701:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132709:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132717:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132842:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132851:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132858:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141855.132867:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783141855.132958:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132966:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132973:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.132978:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141855.132982:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133000:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133013:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141855.133016:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141855.133021:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133027:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898e2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133040:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133046:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133051:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133056:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141855.133058:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133064:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133070:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648a1ad100) 00010000:00010000:0.0:1783141855.133072:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141855.133074:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133088:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da898e35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133130:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da898e27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff13 expref: 50 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133143:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff13 expref: 49 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141855.133150:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:0.0:1783141855.133152:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141855.133155:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6800, rc 0) 00000100:00100000:0.0:1783141855.133523:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+49:10498:x1869759492704384:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 991us (3692us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1783141855.133531:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 102 00000100:00100000:0.0:1783141855.136437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.136855:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492704512 00000100:00100000:2.0:1783141855.136864:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492704512 00000100:00100000:2.0:1783141855.137023:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 103 00000100:00100000:2.0:1783141855.137034:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+49:10498:x1869759492704512:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:2.0:1783141855.137100:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.137116:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.137128:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.137153:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.137160:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.137166:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.137173:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141855.137176:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.137183:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.137198:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:2.0:1783141855.137212:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141855.137217:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.137223:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141855.137299:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+49:10498:x1869759492704512:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 267us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141855.137308:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 103 00000100:00100000:0.0:1783141855.145797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141855.145893:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492704768 00000100:00100000:1.0:1783141855.145903:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492704768 00000100:00100000:1.0:1783141855.146027:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:1.0:1783141855.146037:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+49:10498:x1869759492704768:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1783141855.146346:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+50:10498:x1869759492704768:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 309us (557us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1783141855.146358:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:3.0:1783141855.247131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.247418:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492705024 00000100:00100000:2.0:1783141855.247427:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492705024 00000100:00100000:2.0:1783141855.247806:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:2.0:1783141855.247816:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+50:10508:x1869759492705024:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1783141855.247843:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141855.247846:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783141855.247873:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898dcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fef7 expref: 50 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.247898:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:2.0:1783141855.247902:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141855.247914:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff1a expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.248006:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.248018:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.248043:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141855.248055:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783141855.248179:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff1a expref: 52 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.248194:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff1a expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.248202:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:2.0:1783141855.248205:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141855.248208:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1e00, rc 0) 00000100:00100000:2.0:1783141855.248261:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+51:10508:x1869759492705024:12345-192.168.203.27@tcp:101:bash.0 Request processed in 446us (1139us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783141855.248268:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:0.0:1783141855.253000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141855.253063:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492705280 00000100:00100000:3.0:1783141855.253073:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492705280 00000100:00100000:3.0:1783141855.253131:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:3.0:1783141855.253141:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+51:10508:x1869759492705280:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:3.0:1783141855.253203:0:7171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783141855.253230:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff1a expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.253251:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff13 expref: 50 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.253261:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:3.0:1783141855.253266:0:7171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141855.253566:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.253582:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.253592:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783141855.253645:0:7171:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1783141855.253671:0:7171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7f19c4e reply state 00000000c39809de transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141855.253680:0:7171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141855.255260:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:10508:x1869759492705280:12345-192.168.203.27@tcp:36:bash.0 Request processed in 2112us (2262us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1783141855.255279:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 105 00000020:00080000:3.0:1783141855.255287:0:7171:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783141855.260192:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.260208:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.260215:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.260220:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2043400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141855.260225:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.260231:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.260248:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141855.260251:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141855.260281:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141855.260288:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141855.262542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.263068:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492705408 00000100:00100000:2.0:1783141855.263076:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492705408 00000100:00100000:2.0:1783141855.263168:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 106 00000100:00100000:2.0:1783141855.263179:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+51:10508:x1869759492705408:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1783141855.263202:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141855.263232:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff21 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.263322:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.263353:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.263379:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141855.263409:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783141855.263413:0:10143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141855.263431:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.263487:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff21 expref: 53 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.263505:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff21 expref: 52 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.263514:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:2.0:1783141855.263517:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141855.263520:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0e00, rc 0) 00000100:00100000:2.0:1783141855.263590:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:10508:x1869759492705408:12345-192.168.203.27@tcp:101:bash.0 Request processed in 413us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141855.263598:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 106 00000100:00100000:3.0:1783141855.266431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141855.267588:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492705664 00000100:00100000:1.0:1783141855.267600:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492705664 00000100:00100000:1.0:1783141855.267669:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:1.0:1783141855.267679:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:10508:x1869759492705664:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:1.0:1783141855.267926:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10508:x1869759492705664:12345-192.168.203.27@tcp:35:bash.0 Request processed in 248us (1503us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1783141855.267935:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:3.0:1783141855.364896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.365046:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492705792 00000100:00100000:2.0:1783141855.365055:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492705792 00000100:00100000:2.0:1783141855.365110:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 107 00000100:00100000:2.0:1783141855.365119:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baaca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+53:10514:x1869759492705792:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141855.365143:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141855.365177:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff28 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.365243:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.365256:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.365279:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141855.365341:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1783141855.365345:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141855.365377:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.365403:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898e7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff28 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.365419:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff28 expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.365429:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:2.0:1783141855.365432:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141855.365436:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1200, rc 0) 00000100:00100000:2.0:1783141855.365547:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baaca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10514:x1869759492705792:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 428us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141855.365555:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 107 00000100:00100000:1.0:1783141855.370612:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141855.374384:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492705920 00000100:00100000:3.0:1783141855.374398:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492705920 00000100:00100000:3.0:1783141855.374880:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 108 00000100:00100000:3.0:1783141855.374892:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10514:x1869759492705920:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141855.374913:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141855.374932:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898e89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff2f expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375009:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375024:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375035:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375049:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375057:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375063:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375179:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375188:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375195:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141855.375229:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783141855.375234:0:7171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783141855.375253:0:7171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375265:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375273:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375293:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375300:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375306:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2043400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141855.375310:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375319:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375338:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:3.0:1783141855.375342:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141855.375347:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375352:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898e90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375378:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375385:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375390:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375395:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2042600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141855.375398:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375404:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375412:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff946489eedd00) 00010000:00010000:3.0:1783141855.375415:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141855.375429:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375435:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375545:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898e89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 56 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375562:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 55 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.375569:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:3.0:1783141855.375571:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141855.375574:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a7000, rc 0) 00000100:00100000:3.0:1783141855.375656:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10514:x1869759492705920:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 766us (5053us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141855.375664:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 108 00000100:00100000:0.0:1783141855.380161:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141855.380216:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.381039:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492706176 00000100:00100000:2.0:1783141855.381061:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492706176 00000100:00100000:2.0:1783141855.381127:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 109 00000100:00100000:2.0:1783141855.381139:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10514:x1869759492706176:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141855.381162:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141855.381182:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ea5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff36 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.381276:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.381292:0:10143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff21 expref: 56 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.381300:0:10143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 56 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.381308:0:10143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.381355:0:10143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 56 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.381377:0:10143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 56 pid: 7171 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141855.381392:0:10143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba631500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510544640:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141855.381515:0:10143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff21 expref: 56 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.381533:0:10143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff21 expref: 56 pid: 10143 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141855.381543:0:10143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510544768:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141855.381573:0:10143:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464969d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141855.382112:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492706304 00000100:00100000:3.0:1783141855.382118:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492706304 00010000:00010000:3.0:1783141855.382202:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 57 pid: 7171 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141855.382248:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:3.0:1783141855.382258:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:2369:x1869759492706304:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141855.382269:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141855.382284:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 57 pid: 7171 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.382298:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 57 pid: 7171 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.382331:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:3.0:1783141855.382335:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.382342:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.382349:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141855.382409:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:2369:x1869759492706304:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 153us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141855.382417:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00010000:00010000:2.0:1783141855.385793:0:10143:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.27@tcp) returned -22 from blocking AST (req@0000000040f5f709 x1869759510544640) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 56 pid: 7171 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.385818:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898e9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff2f expref: 56 pid: 7171 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141855.385835:0:10143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba631500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510544640:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141855.385848:0:10143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510544768:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141855.385871:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:2.0:1783141855.385877:0:10143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.385884:0:10143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.385892:0:10143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141855.393011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.395769:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492706432 00000100:00100000:2.0:1783141855.395783:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492706432 00010000:00010000:2.0:1783141855.395845:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff21 expref: 56 pid: 10143 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141855.395892:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:2.0:1783141855.395902:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:2369:x1869759492706432:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141855.395917:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141855.395923:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff21 expref: 56 pid: 10143 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.395936:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff21 expref: 56 pid: 10143 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.395958:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff21 expref: 56 pid: 10143 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.395972:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:2.0:1783141855.395976:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.395986:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.395994:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.396026:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141855.396101:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:2369:x1869759492706432:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 200us (3098us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141855.396109:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00010000:00010000:3.0:1783141855.396566:0:10143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.396575:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141855.396594:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783141855.396738:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ea5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff36 expref: 56 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.396754:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff36 expref: 55 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.396762:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:3.0:1783141855.396765:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141855.396768:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0200, rc 0) 00000100:00100000:3.0:1783141855.396800:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10514:x1869759492706176:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 15663us (16717us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1783141855.396814:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 109 00000100:00100000:0.0:1783141855.410579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.410963:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492706688 00000100:00100000:2.0:1783141855.410973:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492706688 00000100:00100000:2.0:1783141855.411046:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:2.0:1783141855.411057:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10514:x1869759492706688:12345-192.168.203.27@tcp:103:lfs.0 00010000:00010000:2.0:1783141855.411073:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141855.411097:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898e0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff0c expref: 55 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.411113:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:2.0:1783141855.411118:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141855.411176:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10514:x1869759492706688:12345-192.168.203.27@tcp:103:lfs.0 Request processed in 121us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141855.411183:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:0.0:1783141855.413571:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141855.416301:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492706816 00000100:00100000:2.0:1783141855.416316:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492706816 00000100:00100000:2.0:1783141855.416385:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 110 00000100:00100000:2.0:1783141855.416395:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10514:x1869759492706816:12345-192.168.203.27@tcp:58:lfs.0 00010000:00010000:2.0:1783141855.416532:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.416551:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141855.416562:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141855.416742:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1783141855.416833:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10514:x1869759492706816:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 438us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141855.416855:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 110 00000100:00100000:1.0:1783141855.430086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141855.430169:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492706944 00000100:00100000:3.0:1783141855.430179:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492706944 00000100:00100000:3.0:1783141855.430233:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 111 00000100:00100000:3.0:1783141855.430244:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:10514:x1869759492706944:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141855.430273:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141855.430293:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff3d expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.430348:0:7171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.430358:0:7171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898ec1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff3d expref: 55 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.430388:0:7171:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.430400:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898ec1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff3d expref: 55 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.430414:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:3.0:1783141855.430418:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141855.430421:0:7171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898ec1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff3d expref: 55 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141855.430428:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a7a00, rc 0) 00000100:00100000:3.0:1783141855.430524:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10514:x1869759492706944:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 281us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141855.430531:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 111 00010000:00010000:1.0:1783141855.963983:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783141856.026822:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141856.026831:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141856.026868:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1783141856.026875:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141856.026992:0:11546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b2e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510544896:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783141856.029794:0:11546:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783141856.039845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.039960:0:11546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b2e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510544896:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783141856.041138:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492707072 00000100:00100000:3.0:1783141856.041160:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492707072 00000100:00100000:3.0:1783141856.041675:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00100000:3.0:1783141856.041688:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10515:x1869759492707072:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783141856.041719:0:10143:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783141856.041883:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10515:x1869759492707072:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 198us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141856.041891:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 112 00000100:00080000:2.0:1783141856.043511:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141856.056200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.056731:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492707200 00000100:00100000:2.0:1783141856.056741:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492707200 00000100:00100000:2.0:1783141856.056809:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 113 00000100:00100000:2.0:1783141856.056887:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10515:x1869759492707200:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783141856.056955:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.056971:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.056982:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057046:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057054:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057060:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057080:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057087:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057107:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141856.057143:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783141856.057147:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141856.057158:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057168:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057173:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057179:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057184:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141856.057188:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057194:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057204:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:2.0:1783141856.057207:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141856.057211:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057216:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da898ec8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057238:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057243:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057248:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057252:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141856.057254:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057259:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057266:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff94648c722800) 00010000:00010000:2.0:1783141856.057268:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141856.057270:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057276:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ecf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057288:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057293:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057298:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057308:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141856.057310:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057315:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057322:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:2.0:1783141856.057324:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141856.057327:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.057332:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.057420:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10515:x1869759492707200:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 536us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.057428:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 113 00000100:00100000:0.0:1783141856.065199:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141856.065293:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492707456 00000100:00100000:1.0:1783141856.065302:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492707456 00000100:00100000:1.0:1783141856.065382:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:1.0:1783141856.065392:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:10515:x1869759492707456:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141856.065428:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141856.065449:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da898edd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff44 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.065577:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.065592:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.065603:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141856.065614:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783141856.066236:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.066244:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.066251:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.066256:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141856.066261:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.066268:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.066280:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141856.066290:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783141856.066295:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.066302:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898ee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.066365:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da898edd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff44 expref: 57 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.066376:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:1.0:1783141856.066378:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783141856.066381:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da898edd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff44 expref: 57 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.066390:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52c00, rc 0) 00000100:00100000:1.0:1783141856.066539:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:10515:x1869759492707456:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1147us (1348us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1783141856.066547:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 114 00000100:00100000:1.0:1783141856.083202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141856.084801:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492707584 00000100:00100000:3.0:1783141856.084813:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492707584 00000100:00100000:3.0:1783141856.084938:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:3.0:1783141856.084949:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:10515:x1869759492707584:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783141856.084986:0:10143:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783141856.085103:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:10515:x1869759492707584:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 156us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141856.085111:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 115 00000100:00100000:1.0:1783141856.097568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.101928:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492707840 00000100:00100000:2.0:1783141856.101945:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492707840 00000100:00100000:2.0:1783141856.102026:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:2.0:1783141856.102048:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:10515:x1869759492707840:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141856.102069:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141856.102073:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783141856.102102:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff28 expref: 56 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.102123:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:2.0:1783141856.102142:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141856.102156:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ef2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff4b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783141856.102762:0:5787:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1783141856.103010:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.103023:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.103046:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.103100:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da898ef2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff4b expref: 58 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.103116:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff4b expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.103124:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94648c722800) 00010000:00010000:2.0:1783141856.103127:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141856.103130:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0800, rc 0) 00000100:00100000:2.0:1783141856.103198:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:10515:x1869759492707840:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1152us (5639us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1783141856.103206:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 116 00000100:00100000:1.0:1783141856.106933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141856.107178:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492708096 00000100:00100000:0.0:1783141856.107188:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492708096 00000100:00100000:0.0:1783141856.107255:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 117 00000100:00100000:0.0:1783141856.107266:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:10515:x1869759492708096:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141856.107322:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141856.107378:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da898ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff4b expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107397:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94648c722800) 00010000:00010000:0.0:1783141856.107409:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141856.107429:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107442:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107451:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107540:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107549:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107556:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107629:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107637:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107655:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107661:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141856.107665:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107786:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107799:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:0.0:1783141856.107802:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141856.107806:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107812:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107824:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107830:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107835:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107841:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141856.107844:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107862:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107871:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8ccb2a73 (ffff94648a1ad100) 00010000:00010000:0.0:1783141856.107874:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141856.107877:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.107883:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8ccb2a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.108153:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:10515:x1869759492708096:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 887us (1227us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141856.108162:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 117 00000100:00100000:1.0:1783141856.125038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141856.125162:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492708224 00000100:00100000:3.0:1783141856.125172:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492708224 00000100:00100000:3.0:1783141856.125225:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 118 00000100:00100000:3.0:1783141856.125235:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:10515:x1869759492708224:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141856.125254:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141856.125275:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898f15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff52 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.125328:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.125366:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.125378:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.125497:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da898f15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff52 expref: 58 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.125515:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff52 expref: 57 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.125524:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:3.0:1783141856.125527:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783141856.125530:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2043600, rc 0) 00000100:00100000:3.0:1783141856.125574:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:10515:x1869759492708224:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 341us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141856.125580:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 118 00000100:00100000:1.0:1783141856.131683:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141856.131806:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492708480 00000100:00100000:0.0:1783141856.131814:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492708480 00000100:00100000:0.0:1783141856.131862:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 119 00000100:00100000:0.0:1783141856.131871:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:10515:x1869759492708480:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141856.131952:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.131969:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.131981:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783141856.132233:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1783141856.132243:0:5786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363336782213ns, next at 364336779908ns, rc = 0 00000004:00010000:0.0:1783141856.132332:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4151b10 reply state 000000008ce29e3d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.132351:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141856.132445:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:10515:x1869759492708480:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 574us (777us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1783141856.132453:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 119 00010000:00010000:0.0:1783141856.134644:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.134662:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.134669:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.134686:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141856.134695:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.134703:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.134720:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:0.0:1783141856.134723:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783141856.134727:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.134733:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da898f23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141856.141616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141856.141941:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492708608 00000100:00100000:0.0:1783141856.141964:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492708608 00000100:00100000:0.0:1783141856.142020:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:0.0:1783141856.142039:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+58:10515:x1869759492708608:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141856.142064:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141856.142083:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff59 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.142171:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff59 expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.142187:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff59 expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.142208:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:0.0:1783141856.142212:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141856.142215:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7800, rc 0) 00000100:00100000:0.0:1783141856.142280:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:10515:x1869759492708608:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 251us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.142288:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:1.0:1783141856.157860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.157952:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492708736 00000100:00100000:2.0:1783141856.157963:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492708736 00000100:00100000:2.0:1783141856.158042:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:2.0:1783141856.158052:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492708736:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783141856.158352:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2368:x1869759492708736:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 299us (499us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783141856.158369:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00080000:3.0:1783141856.158980:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141856.161399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.161802:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492708992 00000100:00100000:2.0:1783141856.161812:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492708992 00000100:00100000:2.0:1783141856.161864:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:2.0:1783141856.161872:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:10515:x1869759492708992:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783141856.162117:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:10515:x1869759492708992:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 245us (726us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1783141856.162125:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:0.0:1783141856.165022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.165155:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492709248 00000100:00100000:2.0:1783141856.165166:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492709248 00000100:00100000:2.0:1783141856.165220:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:2.0:1783141856.165230:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:10515:x1869759492709248:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783141856.165335:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:10515:x1869759492709248:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 107us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.165343:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 121 00000100:00100000:1.0:1783141856.168962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141856.169058:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492709376 00000100:00100000:3.0:1783141856.169067:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492709376 00000100:00100000:3.0:1783141856.169123:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 122 00000100:00100000:3.0:1783141856.169132:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:10515:x1869759492709376:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141856.169151:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141856.169183:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898f31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff60 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.169252:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898f38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.169276:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.169287:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141856.169320:0:7171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783141856.169336:0:7171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.169367:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898f31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff60 expref: 62 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.169386:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff60 expref: 61 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.169394:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:3.0:1783141856.169397:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783141856.169400:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2043400, rc 0) 00000100:00100000:3.0:1783141856.169455:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:10515:x1869759492709376:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 324us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141856.169504:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 122 00000100:00100000:1.0:1783141856.175343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.175499:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492709504 00000100:00100000:2.0:1783141856.175509:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492709504 00000100:00100000:2.0:1783141856.175564:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:2.0:1783141856.175574:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2369:x1869759492709504:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141856.175591:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141856.175611:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff67 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783141856.175648:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4895df, blocks: 0x1 00010000:00010000:2.0:1783141856.175667:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1783141856.175671:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141856.175691:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff67 expref: 10 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.175707:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff67 expref: 10 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.175720:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1800, rc 0) 00000100:00100000:2.0:1783141856.175781:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:2369:x1869759492709504:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 209us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.175788:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:1.0:1783141856.179219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141856.179362:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492709760 00000100:00100000:3.0:1783141856.179372:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492709760 00000100:00100000:3.0:1783141856.179443:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 123 00000100:00100000:3.0:1783141856.179453:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:10515:x1869759492709760:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783141856.179584:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:10515:x1869759492709760:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 133us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141856.179591:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 123 00000100:00100000:1.0:1783141856.187811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.187995:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492709888 00000100:00100000:2.0:1783141856.188004:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492709888 00000100:00100000:2.0:1783141856.188165:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:2.0:1783141856.188175:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464969d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:10515:x1869759492709888:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141856.188193:0:10144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141856.188210:0:10144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff6e expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.188238:0:10144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff67 expref: 11 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.188274:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141856.188279:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141856.188285:0:10144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 11 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.188319:0:10144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff67 expref: 11 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.188332:0:10144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff67 expref: 11 pid: 6584 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.188345:0:10144:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10144:1869759510545024:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141856.188568:0:10144:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464969d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141856.193102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141856.193198:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492710016 00000100:00100000:0.0:1783141856.193207:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492710016 00010000:00010000:0.0:1783141856.193248:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff67 expref: 12 pid: 6584 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.193303:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:0.0:1783141856.193314:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:2369:x1869759492710016:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141856.193343:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141856.193375:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff67 expref: 12 pid: 6584 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.193388:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff67 expref: 12 pid: 6584 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.193412:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141856.193417:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141856.193427:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 12 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.193447:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 12 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.193523:0:5773:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 12 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.193545:0:5773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5773:1869759510545152:192.168.203.27@tcp:105: 00000100:00100000:0.0:1783141856.193621:0:5773:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f480 going to sleep for 11 seconds 00010000:00010000:2.0:1783141856.193889:0:10144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da898f3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff67 expref: 12 pid: 6584 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.193904:0:10144:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10144:1869759510545024:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141856.193927:0:10144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 11 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.193937:0:10144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1200, rc 0) 00000100:00100000:2.0:1783141856.193967:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464969d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:10515:x1869759492709888:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 5794us (6165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.193985:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:3.0:1783141856.206153:0:5773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5773:1869759510545152:192.168.203.27@tcp:105: 00010000:00010000:3.0:1783141856.206182:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141856.206241:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:2369:x1869759492710016:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 12929us (13149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141856.206252:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:3.0:1783141856.212038:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141856.212121:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492710144 00000100:00100000:1.0:1783141856.212130:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492710144 00002000:00100000:1.0:1783141856.212174:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9464baacb800 x1869759492710144/t0(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:232/0 lens 504/0 e 0 to 0 dl 1783141867 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141856.212185:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464baacb800 with x1869759492710144 ext(0->12) 00002000:00010000:1.0:1783141856.212190:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9464baacb800 00000100:00100000:1.0:1783141856.212219:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:1.0:1783141856.212228:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:2368:x1869759492710144:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783141856.212662:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:2368:x1869759492710144:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 Request processed in 433us (641us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783141856.212669:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00002000:00100000:1.0:1783141856.212962:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9464baacb800 x1869759492710144/t4294967308(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:232/0 lens 504/448 e 0 to 0 dl 1783141867 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141856.212971:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464baacb800 with x1869759492710144 ext(0->12) 00002000:00010000:1.0:1783141856.212975:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9464baacb800 00000100:00100000:1.0:1783141856.224397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141856.224492:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492710272 00000100:00100000:0.0:1783141856.224502:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492710272 00000100:00100000:0.0:1783141856.224558:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00100000:0.0:1783141856.224567:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:10515:x1869759492710272:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783141856.284795:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1783141856.284811:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1783141856.284829:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1783141856.284842:0:5809:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946496f1fcc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1783141856.284846:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9464ba539300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946496f1f780 00000020:00080000:3.0:1783141856.284850:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9464ba539100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9464baadd400 00000004:00080000:3.0:1783141856.284884:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1783141856.284903:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:2.0:1783141856.285235:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:10515:x1869759492710272:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 60663us (60841us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.285245:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 124 00000100:00100000:0.0:1783141856.285680:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510545280:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783141856.285751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1783141856.286295:0:5809:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9464852e3cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1783141856.286300:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9464bfca8b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9464852e3a80 00000020:00080000:3.0:1783141856.286304:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff94648321bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9464972abc00 00000020:00080000:3.0:1783141856.286310:0:5809:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1783141856.286324:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1783141856.286718:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510545408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783141856.286756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1783141856.286897:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783141856.286917:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510545536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783141856.286954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141856.287196:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510545280 00000100:00100000:2.0:1783141856.287204:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510545280 00000100:00100000:2.0:1783141856.287248:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510545408 00000100:00100000:2.0:1783141856.287251:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510545408 00000100:00100000:2.0:1783141856.287266:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510545536 00000100:00100000:2.0:1783141856.287269:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510545536 00000100:00100000:2.0:1783141856.287282:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783141856.287289:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1869759510545280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783141856.287316:0:6587:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1783141856.287344:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a4895de, atime: 0x6a4895de, ctime: 0x6a4895de, blocks: 0x1 00010000:00010000:2.0:1783141856.287352:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.287378:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1783141856.287382:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141856.287388:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.287403:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.287413:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.287442:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.287474:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783141856.287905:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3308:x1869759510545280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 615us (2152us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783141856.287913:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783141856.287933:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783141856.287940:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1869759510545408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783141856.287953:0:6587:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1783141856.287968:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.287982:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fecd expref: 11 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.287991:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783141856.287994:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141856.287998:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.288040:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fecd expref: 11 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.288053:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fecd expref: 11 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141856.288068:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783141856.288073:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510545664:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141856.288077:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1869759510545536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783141856.288131:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcd180 going to sleep for 11 seconds 00002000:00010000:1.0:1783141856.288259:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783141856.288268:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783141855 00002000:00010000:1.0:1783141856.288270:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783141856.288273:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783141855 -> 1783141855 00002000:00010000:1.0:1783141856.288275:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783141856.288304:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1869759510545536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (1349us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783141856.288311:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1783141856.288475:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464ba630a80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1783141856.288482:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510545536:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1783141856.288501:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141856.288504:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783141856.288512:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141856.288517:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.288526:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141856.288530:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.288538:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.288554:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.288561:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fa1f116/0x279ffa91da898f4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.288580:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141856.288581:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141856.288583:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783141856.288858:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464bfc5ca80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1783141856.288864:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510545280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783141856.295794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141856.295866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.295892:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492710400 00000100:00100000:2.0:1783141856.295900:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492710400 00000100:00100000:2.0:1783141856.295960:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:2.0:1783141856.295970:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:2368:x1869759492710400:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783141856.296026:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510545664:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141856.296065:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.297654:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492710528 00000100:00100000:0.0:1783141856.297665:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492710528 00010000:00010000:0.0:1783141856.297706:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fecd expref: 13 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.297757:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:0.0:1783141856.297766:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:2368:x1869759492710528:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141856.297779:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141856.297786:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fecd expref: 13 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.297800:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fecd expref: 13 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.297824:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f85985e4/0x279ffa91da898d0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fecd expref: 13 pid: 6586 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.297841:0:7493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141856.297846:0:7493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141856.297851:0:7493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.297861:0:7493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.297917:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141856.297981:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:2368:x1869759492710528:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 215us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.297988:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00010000:00010000:2.0:1783141856.298265:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.298276:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.298286:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.298293:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.298310:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783141856.298593:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141856.298599:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.298608:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141856.298612:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.298621:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.298634:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.298641:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.298659:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141856.298661:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141856.298662:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141856.298863:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1869759510545408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10922us (12104us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783141856.298872:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1783141856.300098:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9464ba630000/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783141856.300109:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510545408:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1783141856.364623:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1783141856.364654:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1783141856.364660:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1783141856.364915:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492710400:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 68940us (69125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141856.364927:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:1.0:1783141856.369398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141856.369509:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492710784 00000100:00100000:0.0:1783141856.369518:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492710784 00000100:00100000:0.0:1783141856.369587:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 125 00000100:00100000:0.0:1783141856.369596:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:10515:x1869759492710784:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141856.369648:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141856.369742:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da898f38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff60 expref: 15 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.369764:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:0.0:1783141856.369769:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141856.369806:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.369821:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.369831:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141856.370197:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008069c944 reply state 0000000072ccb273 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141856.370207:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141856.370377:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:10515:x1869759492710784:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 780us (985us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1783141856.370385:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 125 00010000:00010000:1.0:1783141856.381784:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.381800:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.381807:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.381814:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141856.381818:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.381826:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.381843:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:1.0:1783141856.381846:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141856.381850:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.381874:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da898f5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141856.385384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141856.385696:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492710912 00000100:00100000:0.0:1783141856.385707:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492710912 00000100:00100000:0.0:1783141856.385762:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:0.0:1783141856.385773:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492710912:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783141856.385977:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783141856.385982:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1783141855 -> 1783141854 00002000:00010000:0.0:1783141856.385984:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783141854 00002000:00010000:0.0:1783141856.385986:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783141855 -> 1783141854 00002000:00010000:0.0:1783141856.385988:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783141856.386320:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492710912:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 547us (943us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783141856.386329:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:0.0:1783141856.397344:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.400597:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492711168 00000100:00100000:2.0:1783141856.400613:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492711168 00000100:00100000:2.0:1783141856.400709:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:2.0:1783141856.400721:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:10515:x1869759492711168:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783141856.400795:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.400812:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff52 expref: 15 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.400822:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.400855:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff52 expref: 15 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.400869:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff52 expref: 15 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.400883:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510545792:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141856.400993:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487f67780 going to sleep for 11 seconds 00000100:00100000:2.0:1783141856.407223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141856.408350:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492711296 00000100:00100000:3.0:1783141856.408375:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492711296 00000100:00100000:1.0:1783141856.408399:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510545792:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141856.408431:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.408448:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff52 expref: 16 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141856.408679:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:3.0:1783141856.408693:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:2369:x1869759492711296:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141856.408715:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141856.408724:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff52 expref: 16 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.408739:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff52 expref: 16 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.408769:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898f1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff52 expref: 16 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.408790:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:3.0:1783141856.408796:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.408806:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.408815:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.408866:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141856.408930:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.409095:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141856.409693:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:2369:x1869759492711296:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 996us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141856.409706:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00010000:00010000:1.0:1783141856.410096:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.410107:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.410114:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.410188:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141856.410193:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.410201:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.410216:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:1.0:1783141856.410234:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783141856.410239:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.410244:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da898f62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141856.410325:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:10515:x1869759492711168:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 Request processed in 9604us (12992us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783141856.410335:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 126 00000100:00100000:1.0:1783141856.418839:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.422660:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492711424 00000100:00100000:2.0:1783141856.422676:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492711424 00000100:00100000:2.0:1783141856.422736:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:2.0:1783141856.422747:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2367:x1869759492711424:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783141856.422794:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.422816:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 7 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.422840:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141856.422844:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141856.422850:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.422887:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 7 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.422900:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 7 pid: 10144 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.422916:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510545920:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141856.423006:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487f673c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.428676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141856.428858:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492711552 00000100:00100000:3.0:1783141856.428868:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492711552 00010000:00010000:3.0:1783141856.428906:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 8 pid: 10144 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141856.428947:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:3.0:1783141856.428956:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492711552:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141856.428972:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141856.428993:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 8 pid: 10144 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.429008:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 8 pid: 10144 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.429036:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141856.429040:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141856.429046:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.429057:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.429096:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141856.429157:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492711552:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 201us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141856.429165:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00010000:00010000:2.0:1783141856.429568:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070aab1e6/0x279ffa91da898f46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff6e expref: 7 pid: 10144 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.429584:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510545920:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141856.429603:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.429613:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.429621:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.429651:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.429659:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.429667:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.429673:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141856.429677:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.429685:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.429696:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.429704:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001976c159/0x279ffa91da898f69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.429797:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492711424:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 7052us (10967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.429805:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:0.0:1783141856.447107:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.447179:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492711808 00000100:00100000:2.0:1783141856.447188:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492711808 00000100:00100000:2.0:1783141856.447248:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 127 00000100:00100000:2.0:1783141856.447269:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:10515:x1869759492711808:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783141856.447362:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.447379:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.447391:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.447602:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.447614:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff59 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.447622:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.447653:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff59 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.447665:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff59 expref: 15 pid: 5788 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.447679:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba630700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510546048:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141856.447755:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487f673c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141856.455842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141856.455920:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492711936 00000100:00100000:3.0:1783141856.455929:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492711936 00010000:00010000:3.0:1783141856.455968:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff59 expref: 16 pid: 5788 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141856.456008:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:3.0:1783141856.456018:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:2369:x1869759492711936:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141856.456033:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141856.456040:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff59 expref: 16 pid: 5788 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.456054:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff59 expref: 16 pid: 5788 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.456076:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:3.0:1783141856.456081:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.456090:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.456098:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141856.456129:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141856.456274:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:2369:x1869759492711936:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 257us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141856.456282:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 58 00010000:00010000:2.0:1783141856.456393:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da898f2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff59 expref: 15 pid: 5788 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.456409:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba630700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510546048:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141856.456428:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.456437:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.456442:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141856.457009:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1783141856.457142:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1783141856.457182:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1783141856.457256:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488314e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1869759510546176:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783141856.457307:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141856.457364:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141856.458072:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510546176 00000100:00100000:2.0:1783141856.458079:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510546176 00000100:00100000:2.0:1783141856.458127:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783141856.458136:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5786:x1869759510546176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783141856.458320:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5786:x1869759510546176:12345-0@lo:1000:mdt00_000.0 Request processed in 74us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.458327:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783141856.458437:0:5786:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1783141856.458443:0:5786:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1783141856.458475:0:5786:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464ba630a80, transno 4294967309 00000100:00100000:1.0:1783141856.458490:0:5786:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9464ba630000 x1869759510545408/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783141872 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141856.458501:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488314e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1869759510546176:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1783141856.458893:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1783141856.458952:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488314e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1869759510546304:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783141856.458992:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141856.459014:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489cf1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141856.459111:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510546304 00000100:00100000:3.0:1783141856.459117:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510546304 00000100:00100000:3.0:1783141856.459151:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141856.459159:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5786:x1869759510546304:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783141856.459452:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5786:x1869759510546304:12345-0@lo:1000:mdt00_000.0 Request processed in 295us (460us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783141856.459457:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783141856.459519:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488314e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1869759510546304:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783141856.459558:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459568:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459575:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459580:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141856.459584:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459592:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459606:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff946489eedd00) 00010000:00010000:1.0:1783141856.459609:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783141856.459614:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459621:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da898f77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459647:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459654:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459660:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459680:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141856.459683:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459689:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459698:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141856.459700:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783141856.459706:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff3d expref: 18 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459716:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898ec1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff3d expref: 18 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459725:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff3d expref: 18 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.459749:0:5786:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff3d expref: 18 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141856.459759:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488317800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510546432:192.168.203.27@tcp:105: 00000100:00100000:1.0:1783141856.459875:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff946483fcd540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141856.465890:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488317800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510546432:192.168.203.27@tcp:105: 00010000:00010000:1.0:1783141856.465928:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.465960:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da898eba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.465993:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466007:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466019:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466031:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466037:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466043:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466049:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141856.466053:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466060:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466071:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141856.466074:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141856.466077:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466092:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466104:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466110:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466116:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466121:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141856.466124:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466130:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466138:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141856.466141:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783141856.466144:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.466150:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da898f70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141856.466553:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:10515:x1869759492711808:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 19294us (19453us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1783141856.466563:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 127 00000020:00080000:1.0:1783141856.466574:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783141856.466772:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141856.466777:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141856.467287:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783141856.467295:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783141856.479792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141856.479871:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492712064 00000100:00100000:1.0:1783141856.479881:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492712064 00000100:00100000:1.0:1783141856.479939:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:1.0:1783141856.479951:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:10514:x1869759492712064:12345-192.168.203.27@tcp:49:lfs.0 00000100:00100000:1.0:1783141856.480084:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:10514:x1869759492712064:12345-192.168.203.27@tcp:49:lfs.0 Request processed in 135us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141856.480093:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:0.0:1783141856.486781:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141856.490398:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492712320 00000100:00100000:1.0:1783141856.490412:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492712320 00000100:00100000:1.0:1783141856.490692:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:1.0:1783141856.490705:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:10515:x1869759492712320:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783141856.493791:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783141856.493921:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1783141856.493996:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.494013:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.494025:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.494033:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.494040:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.494047:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.494125:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783141856.494234:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:10515:x1869759492712320:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 3529us (7459us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1783141856.494244:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00000020:00080000:1.0:1783141856.494251:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783141856.497140:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141856.497222:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492712576 00000100:00100000:1.0:1783141856.497232:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492712576 00000100:00100000:1.0:1783141856.497306:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00100000:1.0:1783141856.497317:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:10514:x1869759492712576:12345-192.168.203.27@tcp:58:lfs.0 00010000:00010000:0.0:1783141856.497586:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141856.497595:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.497607:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141856.497612:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783141856.497628:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:0.0:1783141856.497636:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.497655:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94648beca300) 00010000:00010000:0.0:1783141856.497659:0:7492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783141856.497663:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.497670:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898f85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141856.497692:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141856.497694:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141856.497696:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141856.497716:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:10514:x1869759492712576:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 400us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141856.497726:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 128 00000100:00100000:2.0:1783141856.566077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141856.566200:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492712704 00000100:00100000:1.0:1783141856.566211:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492712704 00000100:00100000:1.0:1783141856.566352:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 129 00000100:00100000:1.0:1783141856.566417:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:10517:x1869759492712704:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1783141856.566440:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141856.566485:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898f8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff75 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566572:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566587:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566616:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566631:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566638:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566645:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566922:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566933:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff36 expref: 21 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566942:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566974:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff36 expref: 21 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.566987:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff36 expref: 21 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141856.567001:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946488317800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510546560:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141856.567096:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff946493cdad80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141856.572990:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946488317800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510546560:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141856.573019:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.576729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141856.577028:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492712960 00000100:00100000:3.0:1783141856.577041:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492712960 00000100:00100000:3.0:1783141856.577206:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:3.0:1783141856.577222:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:5577:x1869759492712960:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783141856.577731:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:5577:x1869759492712960:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 512us (1015us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1783141856.577740:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:0.0:1783141856.581328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141856.581640:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492713088 00000100:00100000:2.0:1783141856.581653:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492713088 00010000:00010000:2.0:1783141856.581722:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff36 expref: 23 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141856.581773:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:2.0:1783141856.581785:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:2368:x1869759492713088:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141856.581805:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141856.581813:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff36 expref: 23 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.581827:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff36 expref: 23 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.581852:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da898eac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff36 expref: 23 pid: 10143 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.581870:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:2.0:1783141856.581876:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.581887:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.581895:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141856.581931:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141856.582002:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:2368:x1869759492713088:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 219us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141856.582011:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00010000:00010000:1.0:1783141856.582132:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582150:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141856.582201:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783141856.582207:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141856.582232:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582248:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582258:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582264:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582272:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582279:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141856.582283:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582290:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582324:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:1.0:1783141856.582327:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141856.582331:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582337:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da898f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582365:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582372:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582378:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582383:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141856.582386:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582391:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582399:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94648becac00) 00010000:00010000:1.0:1783141856.582401:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141856.582404:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582409:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da898f9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582590:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898f8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff75 expref: 22 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582606:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff75 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141856.582614:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141856.582616:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141856.582618:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53200, rc 0) 00000100:00100000:1.0:1783141856.582698:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:10517:x1869759492712704:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 16284us (16629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141856.582706:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 129 00000001:00080000:1.0:1783141856.838106:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1783141856.838132:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1783141856.838330:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1783141856.838340:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1783141856.986632:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783141857.276862:0:11918:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141857.276870:0:11918:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141857.276909:0:11918:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783141857.276914:0:11918:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141857.306783:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783141857.306805:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510546688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141857.306868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141857.306989:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510546688 00000100:00100000:2.0:1783141857.306995:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510546688 00000100:00100000:2.0:1783141857.307045:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783141857.307053:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510546688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141857.307087:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141857.307137:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510546688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141857.307145:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783141857.307231:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1783141857.307236:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1783141857.307269:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464ba8ff480, transno 4294967301 00000004:00080000:3.0:1783141857.307291:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1783141857.307305:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464bfc5ca80, transno 4294967304 00000100:00100000:3.0:1783141857.307316:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510546688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141857.316769:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510546944:0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.316836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141857.316881:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141857.316887:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510547072:0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.316910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141857.316943:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510546944 00000100:00100000:2.0:1783141857.316950:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510546944 00000100:00100000:2.0:1783141857.316989:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510547072 00000100:00100000:2.0:1783141857.316992:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510547072 00000100:00100000:2.0:1783141857.317024:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783141857.317033:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510546944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317084:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510546944:12345-0@lo:400:kworker.0 Request processed in 52us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141857.317092:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783141857.317109:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783141857.317115:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510547072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317156:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510547072:12345-0@lo:400:kworker.0 Request processed in 42us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141857.317163:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1783141857.317182:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141857.317213:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510547072:0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317224:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510546944:0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317246:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510547200:0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141857.317288:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783141857.317294:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510546816:0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141857.317343:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510547328:0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317618:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141857.317643:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510547200 00000100:00100000:2.0:1783141857.317647:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510547200 00000100:00100000:2.0:1783141857.317676:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783141857.317682:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464883d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510547200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317717:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464883d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510547200:12345-0@lo:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141857.317722:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783141857.317739:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510546816 00000100:00100000:2.0:1783141857.317743:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510546816 00000100:00100000:2.0:1783141857.317768:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1783141857.317775:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510546816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317804:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510546816:12345-0@lo:400:kworker.0 Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141857.317818:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:2.0:1783141857.317840:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141857.317861:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510546816:0@lo:400:kworker.0 00000100:00100000:2.0:1783141857.317872:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510547200:0@lo:400:kworker.0 00000100:00100000:0.0:1783141857.318186:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510547328 00000100:00100000:0.0:1783141857.318191:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510547328 00000100:00100000:0.0:1783141857.318220:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141857.318227:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1869759510547328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141857.318291:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1869759510547328:12345-0@lo:400:kworker.0 Request processed in 64us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141857.318297:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783141857.318517:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510547328:0@lo:400:kworker.0 00000040:00080000:2.0:1783141857.499004:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141857.499014:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141857.499072:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783141857.499079:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783141857.499199:0:11546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba633800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510547456:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783141857.499389:0:11546:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649685d300 going to sleep for 11 seconds 00000100:00100000:0.0:1783141857.504408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141857.504590:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141857.504621:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141857.504651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141857.504676:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141857.504742:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492713344 00000100:00100000:0.0:1783141857.504763:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492713344 00000100:00100000:3.0:1783141857.504802:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492713472 00000100:00100000:3.0:1783141857.504807:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492713472 00000100:00100000:3.0:1783141857.504850:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492713600 00000100:00100000:3.0:1783141857.504852:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492713600 00000100:00100000:3.0:1783141857.504873:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:3.0:1783141857.504883:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492713472:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141857.505005:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492713728 00000100:00100000:1.0:1783141857.505010:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492713728 00000100:00100000:3.0:1783141857.505031:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492713472:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 148us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141857.505039:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:1.0:1783141857.505048:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00100000:1.0:1783141857.505058:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492713728:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141857.505063:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:3.0:1783141857.505075:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492713600:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141857.505104:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492713728:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 46us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141857.505110:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492713600:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 35us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141857.505118:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00100000:3.0:1783141857.505123:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00080000:3.0:1783141857.505149:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141857.505154:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141857.505192:0:11546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba633800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510547456:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783141857.505646:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:0.0:1783141857.505655:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:2366:x1869759492713344:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141857.505769:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:2366:x1869759492713344:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 45us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141857.505778:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:2.0:1783141857.506112:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492713216 00000100:00100000:2.0:1783141857.506118:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492713216 00000100:00100000:2.0:1783141857.506201:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 287 00000100:00100000:2.0:1783141857.506211:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492713216:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141857.506257:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492713216:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 49us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141857.506264:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 287 00000100:00100000:0.0:1783141857.509222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141857.509509:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492713856 00000100:00100000:1.0:1783141857.509518:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492713856 00000100:00100000:1.0:1783141857.509584:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 130 00000100:00100000:1.0:1783141857.509594:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:10530:x1869759492713856:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783141857.509624:0:5788:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783141857.509798:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:10530:x1869759492713856:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 205us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141857.509806:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 130 00000100:00100000:1.0:1783141857.519425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141857.524405:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492714112 00000100:00100000:0.0:1783141857.524421:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492714112 00000100:00100000:0.0:1783141857.528121:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:0.0:1783141857.528144:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:10530:x1869759492714112:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141857.528166:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141857.528188:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898fa8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff7c expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141857.528300:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898faf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141857.528314:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141857.528327:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141857.528338:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783141857.528498:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da898fa8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff7c expref: 24 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141857.528518:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898faf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff7c expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141857.528540:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:0.0:1783141857.528544:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141857.528547:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6800, rc 0) 00000100:00100000:0.0:1783141857.528612:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:10530:x1869759492714112:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 478us (9194us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1783141857.528620:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 131 00000100:00100000:3.0:1783141857.535448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141857.535673:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492714240 00000100:00100000:0.0:1783141857.535682:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492714240 00000100:00100000:0.0:1783141857.535735:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:0.0:1783141857.535746:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:2369:x1869759492714240:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141857.535761:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141857.535785:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6800/0x279ffa91da898faf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff7c expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141857.535804:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:0.0:1783141857.535809:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141857.535866:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:2369:x1869759492714240:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 122us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141857.535873:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:2.0:1783141857.543690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141857.543806:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492714496 00000100:00100000:3.0:1783141857.543816:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492714496 00000100:00100000:3.0:1783141857.543872:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 132 00000100:00100000:3.0:1783141857.543882:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:10530:x1869759492714496:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783141857.543967:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141857.544002:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141857.544014:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141857.544191:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141857.544199:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141857.544206:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141857.544213:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2043600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141857.544217:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141857.544225:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141857.544236:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:3.0:1783141857.544239:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783141857.544243:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141857.544248:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141857.544965:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:10530:x1869759492714496:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 1076us (1277us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1783141857.544983:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 132 00000040:00080000:1.0:1783141857.545338:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141857.545344:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141857.546069:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783141857.546079:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141857.548145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141857.548226:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492714752 00000100:00100000:3.0:1783141857.548235:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492714752 00000100:00100000:3.0:1783141857.548293:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:3.0:1783141857.548302:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:10530:x1869759492714752:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783141857.548705:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:10530:x1869759492714752:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 401us (565us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1783141857.548713:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:3.0:1783141857.818772:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141857.823740:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510547584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141857.823815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141857.825504:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510547584 00000100:00100000:1.0:1783141857.825516:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510547584 00000100:00100000:1.0:1783141857.825576:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783141857.825585:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1869759510547584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141857.825620:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141857.825685:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1869759510547584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141857.825693:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783141857.825891:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510547584:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783141858.011855:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141859.036559:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783141859.146207:0:11969:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141859.146217:0:11969:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141859.146262:0:11969:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783141859.146268:0:11969:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141859.335401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141859.335435:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492715008 00000100:00100000:3.0:1783141859.335444:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492715008 00000100:00100000:3.0:1783141859.335520:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00100000:3.0:1783141859.335530:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:10550:x1869759492715008:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141859.335564:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141859.335583:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff83 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141859.335675:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898fcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141859.335689:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141859.335722:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141859.335734:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783141859.335869:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043600/0x279ffa91da898fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff83 expref: 27 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141859.335885:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff83 expref: 26 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141859.335894:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:3.0:1783141859.335897:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783141859.335900:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2042600, rc 0) 00000100:00100000:3.0:1783141859.335951:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:10550:x1869759492715008:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 422us (559us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1783141859.335959:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 133 00000100:00080000:3.0:1783141859.335981:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141859.341354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141859.341426:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492715136 00000100:00100000:1.0:1783141859.341435:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492715136 00000100:00100000:1.0:1783141859.341519:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:1.0:1783141859.341529:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:10550:x1869759492715136:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:1.0:1783141859.341602:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141859.341619:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141859.341630:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141859.341656:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141859.341663:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141859.341670:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141859.341677:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141859.341681:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141859.341689:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141859.341700:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141859.341703:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783141859.341707:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141859.341728:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53c00/0x279ffa91da898fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141859.341812:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:10550:x1869759492715136:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 283us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141859.341819:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 134 00000100:00100000:1.0:1783141859.455139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141859.455245:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492715264 00000100:00100000:3.0:1783141859.455259:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492715264 00000100:00100000:3.0:1783141859.455368:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:3.0:1783141859.455382:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2366:x1869759492715264:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:3.0:1783141859.455407:0:10144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141859.455438:0:10144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000810aad06/0x279ffa91da898fe0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff8a expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141859.455529:0:10144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4895de, atime: 0x6a4895de, ctime: 0x6a4895de, blocks: 0xb 00000100:00080000:0.0:1783141859.455675:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783141859.455809:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1783141859.455831:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141859.455843:0:10144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000810aad06/0x279ffa91da898fe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff8a expref: 7 pid: 10144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141859.455865:0:10144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000810aad06/0x279ffa91da898fe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff8a expref: 7 pid: 10144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141859.455882:0:10144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2043600, rc 0) 00000100:00100000:3.0:1783141859.455961:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2366:x1869759492715264:12345-192.168.203.27@tcp:101:cat.0 Request processed in 582us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141859.455969:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:1.0:1783141859.474860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141859.475180:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492715392 00000100:00100000:3.0:1783141859.475194:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492715392 00002000:00100000:3.0:1783141859.475273:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff946497437480 x1869759492715392/t0(0) o3->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:235/0 lens 488/0 e 0 to 0 dl 1783141870 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141859.475291:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946497437480 with x1869759492715392 ext(0->4095) 00002000:00010000:3.0:1783141859.475299:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946497437480 00000100:00100000:3.0:1783141859.475350:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:3.0:1783141859.475360:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492715392:12345-192.168.203.27@tcp:3:cat.0 00000100:00100000:3.0:1783141859.476183:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492715392:12345-192.168.203.27@tcp:3:cat.0 Request processed in 816us (1337us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1783141859.476195:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00002000:00100000:3.0:1783141859.476203:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff946497437480 x1869759492715392/t0(0) o3->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:235/0 lens 488/4536 e 0 to 0 dl 1783141870 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141859.476214:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946497437480 with x1869759492715392 ext(0->4095) 00002000:00010000:3.0:1783141859.476242:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946497437480 00010000:00010000:3.0:1783141860.060312:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141861.083108:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783141861.529368:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:3.0:1783141861.529399:0:5809:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946483fcdc00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1783141861.529404:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff946496f78700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946483fcd9c0 00000020:00080000:3.0:1783141861.529407:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff946496f78a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9464bfdd8800 00000001:00080000:3.0:1783141861.529425:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1783141861.529437:0:5809:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1783141861.529447:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1783141861.529627:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1783141861.538779:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1783141861.538807:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1783141861.538813:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1783141862.106899:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141862.427673:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141862.427695:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510547712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141862.427772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141862.427844:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510547712 00000100:00100000:0.0:1783141862.427851:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510547712 00000100:00100000:0.0:1783141862.427908:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783141862.427917:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510547712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141862.427949:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141862.427986:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510547712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141862.427993:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1783141862.428011:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141862.428043:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510547712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141862.430108:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510547840:0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430171:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141862.430206:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510548352:0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141862.430259:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141862.430264:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510547968:0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141862.430331:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510547840 00000100:00100000:1.0:1783141862.430338:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510547840 00000100:00100000:1.0:1783141862.430377:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1783141862.430384:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510547840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430431:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510547840:12345-0@lo:400:kworker.0 Request processed in 47us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141862.430438:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1783141862.430490:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510548352 00000100:00100000:1.0:1783141862.430494:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510548352 00000100:00100000:1.0:1783141862.430531:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783141862.430537:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510548352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430569:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510548352:12345-0@lo:400:kworker.0 Request processed in 32us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141862.430575:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783141862.430590:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510547968 00000100:00100000:1.0:1783141862.430593:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510547968 00000100:00100000:1.0:1783141862.430617:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783141862.430622:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510547968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430650:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510547968:12345-0@lo:400:kworker.0 Request processed in 28us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141862.430656:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1783141862.430690:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141862.430701:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510548096:0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141862.430743:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141862.430748:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510548224:0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141862.430790:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510548096 00000100:00100000:1.0:1783141862.430794:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510548096 00000100:00100000:1.0:1783141862.430818:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510548224 00000100:00100000:1.0:1783141862.430821:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510548224 00000100:00100000:1.0:1783141862.430840:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783141862.430846:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510548096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430878:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510548096:12345-0@lo:400:kworker.0 Request processed in 32us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141862.430892:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783141862.430904:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783141862.430909:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510548224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430938:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510548224:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141862.430944:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1783141862.430963:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141862.430988:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510548224:0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.430997:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510548096:0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.431019:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510547968:0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.431026:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510547840:0@lo:400:kworker.0 00000100:00100000:1.0:1783141862.431033:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1783141862.431037:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9464ba630000, transno 4294967310 00000004:00080000:1.0:1783141862.431047:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1783141862.431064:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510548352:0@lo:400:kworker.0 00000100:00100000:3.0:1783141862.618727:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141862.618761:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141862.618798:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141862.618817:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141862.618842:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141862.619081:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492715904 00000100:00100000:3.0:1783141862.619093:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492715904 00000100:00100000:3.0:1783141862.619150:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492715776 00000100:00100000:3.0:1783141862.619153:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492715776 00000100:00100000:3.0:1783141862.619186:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:3.0:1783141862.619196:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492715904:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141862.619292:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492715904:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 96us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141862.619300:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:3.0:1783141862.619330:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:3.0:1783141862.619337:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2368:x1869759492715776:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141862.619383:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2368:x1869759492715776:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 46us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141862.619390:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:2.0:1783141862.619575:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492715520 00000100:00100000:2.0:1783141862.619580:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492715520 00000100:00100000:2.0:1783141862.619656:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 289 00000100:00100000:2.0:1783141862.619665:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492715520:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141862.619697:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2368:x1869759492715520:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 34us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141862.619714:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 289 00000100:00100000:1.0:1783141862.619809:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492715648 00000100:00100000:1.0:1783141862.619815:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492715648 00000100:00100000:1.0:1783141862.619848:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492716032 00000100:00100000:1.0:1783141862.619862:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492716032 00000100:00100000:1.0:1783141862.619884:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 138 00000100:00100000:1.0:1783141862.619891:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:2368:x1869759492715648:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141862.619927:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:2368:x1869759492715648:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 36us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141862.619945:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 138 00000100:00100000:1.0:1783141862.619958:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 139 00000100:00100000:1.0:1783141862.619964:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2368:x1869759492716032:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141862.619988:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2368:x1869759492716032:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 25us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141862.619994:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 139 00000100:00080000:1.0:1783141862.620014:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783141862.620019:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141862.620021:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141862.939004:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649d1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510548480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141862.939104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141862.939342:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510548480 00000100:00100000:1.0:1783141862.939354:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510548480 00000100:00100000:1.0:1783141862.939429:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783141862.939440:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510548480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141862.939520:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141862.939575:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510548480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141862.939583:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783141862.939740:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649d1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510548480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783141863.134685:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141864.102765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141864.106551:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492716160 00000100:00100000:2.0:1783141864.106573:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492716160 00000100:00100000:3.0:1783141864.106932:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 135 00000100:00100000:3.0:1783141864.106950:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:10203:x1869759492716160:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783141864.107903:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:10203:x1869759492716160:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 Request processed in 953us (5146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141864.107916:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 135 00000100:00080000:1.0:1783141864.108011:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141864.119033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141864.119365:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492716416 00000100:00100000:3.0:1783141864.119380:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492716416 00000100:00100000:3.0:1783141864.119449:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:3.0:1783141864.119485:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:10203:x1869759492716416:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783141864.120110:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:10203:x1869759492716416:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 646us (1086us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1783141864.120119:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00010000:00010000:0.0:1783141864.154707:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141864.331434:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141864.331570:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492716544 00000100:00100000:1.0:1783141864.331583:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492716544 00000100:00100000:1.0:1783141864.331696:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 136 00000100:00100000:1.0:1783141864.331708:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:11003:x1869759492716544:12345-192.168.203.27@tcp:101:lsof.0 00010000:00010000:1.0:1783141864.331736:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141864.331762:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da898fe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff91 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141864.331864:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141864.331881:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141864.331895:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141864.332144:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783141864.332149:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141864.332260:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141864.332292:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da898fe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff91 expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141864.332324:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff91 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141864.332334:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141864.332338:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141864.332343:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52200, rc 0) 00000100:00100000:1.0:1783141864.332429:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+6:11003:x1869759492716544:12345-192.168.203.27@tcp:101:lsof.0 Request processed in 723us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141864.332437:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 136 00000100:00080000:2.0:1783141864.334232:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783141865.178732:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783141865.754810:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141865.754823:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141865.755188:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1783141865.755197:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783141866.204103:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783141866.636630:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1783141866.636644:0:5809:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1783141866.636726:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1783141866.636740:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1783141867.226604:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141867.546753:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510548736:0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.546910:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510548608:0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.546957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141867.547005:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510548992:0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.547016:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510549120:0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.547042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141867.547060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141867.547077:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510548864:0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.547099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141867.547113:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510548992 00000100:00100000:2.0:1783141867.547120:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510548992 00000100:00100000:3.0:1783141867.547135:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510548608 00000100:00100000:3.0:1783141867.547138:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510548608 00000100:00100000:3.0:1783141867.547164:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1783141867.547164:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783141867.547172:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510548608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141867.547172:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510548992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.547227:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3305:x1869759510548608:12345-0@lo:400:kworker.0 Request processed in 54us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141867.547227:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510548992:12345-0@lo:400:kworker.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141867.547234:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1783141867.547234:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783141867.547255:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510549120 00000100:00100000:2.0:1783141867.547259:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510549120 00000100:00100000:3.0:1783141867.547262:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510548864 00000100:00100000:3.0:1783141867.547264:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510548864 00000100:00100000:1.0:1783141867.547297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141867.547307:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510548736 00000100:00100000:2.0:1783141867.547310:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510548736 00000100:00100000:1.0:1783141867.547850:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510549248:0@lo:400:kworker.0 00000100:00100000:1.0:1783141867.547882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141867.547917:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783141867.552329:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783141867.552344:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510548864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.552429:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510548864:12345-0@lo:400:kworker.0 Request processed in 88us (5328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141867.552437:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783141867.552524:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510549376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141867.552566:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141867.552611:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510548864:0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.552643:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510549376 00000100:00100000:3.0:1783141867.552648:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510549376 00000100:00100000:3.0:1783141867.552675:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141867.552681:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510549376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141867.552707:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141867.552739:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510549376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141867.552745:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141867.552771:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510548608:0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.552811:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510549376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141867.554074:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510549248 00000100:00100000:3.0:1783141867.554085:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510549248 00000100:00100000:3.0:1783141867.554134:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783141867.554143:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510549248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141867.554222:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510549248:12345-0@lo:400:kworker.0 Request processed in 80us (6339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141867.554229:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1783141867.554250:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141867.554254:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141867.554257:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141867.554314:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510548992:0@lo:400:kworker.0 00000100:00100000:2.0:1783141867.554569:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783141867.554589:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510548736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141867.554629:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510548736:12345-0@lo:400:kworker.0 Request processed in 41us (7331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141867.554635:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783141867.555604:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510548736:0@lo:400:kworker.0 00000100:00100000:2.0:1783141867.555620:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510549248:0@lo:400:kworker.0 00000100:00100000:1.0:1783141867.562575:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510549120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141867.562756:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baaca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510549120:12345-0@lo:400:kworker.0 Request processed in 14830us (15711us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141867.562767:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783141867.562823:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510549120:0@lo:400:kworker.0 00000100:00100000:2.0:1783141867.743171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141867.743289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141867.743314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141867.743336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141867.743357:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141867.743382:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492716672 00000100:00100000:2.0:1783141867.743391:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492716672 00000100:00100000:2.0:1783141867.743433:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 291 00000100:00100000:2.0:1783141867.743444:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492716672:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141867.743529:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492716672:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 87us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141867.743538:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 291 00000100:00100000:2.0:1783141867.743568:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492716928 00000100:00100000:2.0:1783141867.743571:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492716928 00000100:00100000:2.0:1783141867.743597:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492717056 00000100:00100000:2.0:1783141867.743599:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492717056 00000100:00100000:2.0:1783141867.743617:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:2.0:1783141867.743622:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492716928:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141867.743647:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492716928:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141867.743662:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:2.0:1783141867.743672:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:2.0:1783141867.743677:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492717056:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141867.743699:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492717056:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 22us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141867.743703:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:2.0:1783141867.743718:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492717184 00000100:00100000:2.0:1783141867.743721:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492717184 00000100:00100000:2.0:1783141867.743741:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492716800 00000100:00100000:2.0:1783141867.743743:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492716800 00000100:00100000:2.0:1783141867.743756:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:2.0:1783141867.743761:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2367:x1869759492717184:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141867.743785:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2367:x1869759492717184:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 23us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141867.743790:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:2.0:1783141867.743800:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00100000:2.0:1783141867.743805:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94648503a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:2367:x1869759492716800:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141867.743826:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94648503a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:2367:x1869759492716800:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 21us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141867.743831:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00080000:3.0:1783141867.745317:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783141867.745325:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783141867.745328:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1783141867.820733:0:12172:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:11:06 (1783141866) 00000100:00100000:2.0:1783141868.058739:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141868.058763:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510549504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141868.058834:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141868.059054:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510549504 00000100:00100000:0.0:1783141868.059063:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510549504 00000100:00100000:0.0:1783141868.059113:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783141868.059123:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510549504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141868.059157:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141868.059376:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510549504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141868.059384:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783141868.063250:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510549504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783141868.250650:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141868.865198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141868.868122:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492717440 00000100:00100000:1.0:1783141868.868145:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492717440 00000100:00100000:1.0:1783141868.868246:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 137 00000100:00100000:1.0:1783141868.868260:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:11267:x1869759492717440:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141868.868688:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141868.868747:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898ff5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff98 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.868825:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.868918:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.868932:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.868949:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.868970:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.868977:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.870402:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da89900a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.870903:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da89900a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.870917:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da89900a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141868.870930:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1783141868.871155:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871164:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871170:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871176:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141868.871179:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871186:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871211:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94648a1ad000) 00010000:00010000:1.0:1783141868.871214:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141868.871220:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871226:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da898ffc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871239:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871245:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871250:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871256:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141868.871259:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871264:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871282:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94648beca600) 00010000:00010000:1.0:1783141868.871285:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141868.871288:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871294:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899003 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871712:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da898ff5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff98 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871728:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da89900a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff98 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141868.871734:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:1.0:1783141868.871736:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141868.871738:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52600, rc 0) 00000100:00100000:1.0:1783141868.871805:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:11267:x1869759492717440:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 3548us (6635us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1783141868.871814:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 137 00000100:00100000:0.0:1783141868.876408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141868.876558:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492717568 00000100:00100000:2.0:1783141868.876568:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492717568 00000100:00100000:2.0:1783141868.876630:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 138 00000100:00100000:2.0:1783141868.876639:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:11267:x1869759492717568:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783141868.876744:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:11267:x1869759492717568:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 Request processed in 105us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141868.876752:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 138 00000100:00100000:2.0:1783141868.877869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141868.879376:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492717696 00000100:00100000:3.0:1783141868.879388:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492717696 00000100:00100000:3.0:1783141868.880341:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:3.0:1783141868.880356:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:2366:x1869759492717696:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141868.880372:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141868.880398:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da89900a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff98 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141868.880429:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:3.0:1783141868.880435:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141868.880520:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:2366:x1869759492717696:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 169us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141868.880543:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00010000:00010000:3.0:1783141869.274854:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783141869.851112:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141869.851721:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141869.851773:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1783141869.851780:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783141870.299899:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141871.013117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.017183:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492717824 00000100:00100000:3.0:1783141871.017198:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492717824 00000100:00100000:3.0:1783141871.017288:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 139 00000100:00100000:3.0:1783141871.017299:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:11310:x1869759492717824:12345-192.168.203.27@tcp:101:lfs.0 00000100:00080000:0.0:1783141871.017312:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783141871.017318:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141871.017387:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da899018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ff9f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017473:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017487:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017500:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017515:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017522:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017529:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017785:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017797:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017803:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017808:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a7000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141871.017812:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017818:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017829:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141871.017832:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.017836:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017841:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da89901f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017851:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017857:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017862:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017866:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141871.017875:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017881:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017888:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff946489eed300) 00010000:00010000:3.0:1783141871.017890:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.017893:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017897:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899026 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017927:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da899018 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff9f expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017936:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141871.017938:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.017941:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da899018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff9f expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.017950:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2043400, rc 0) 00000100:00100000:3.0:1783141871.018014:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:11310:x1869759492717824:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 717us (4914us total) trans 0 rc 301/301 00000100:00100000:3.0:1783141871.018022:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 139 00000100:00100000:1.0:1783141871.045382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141871.045697:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492718080 00000100:00100000:1.0:1783141871.045707:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492718080 00000100:00100000:1.0:1783141871.045756:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 140 00000100:00100000:1.0:1783141871.045767:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:11310:x1869759492718080:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:1.0:1783141871.045821:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141871.045848:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6000/0x279ffa91da898996 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdd8 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.045869:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141871.045874:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141871.046134:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.046159:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff91 expref: 5 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.046168:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.046202:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff91 expref: 5 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.046215:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff91 expref: 5 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141871.046229:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510549632:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141871.047719:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464852e3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141871.058712:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464974e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510549632:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141871.058744:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141871.068503:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141871.069014:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492718208 00000100:00100000:0.0:1783141871.069024:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492718208 00010000:00010000:0.0:1783141871.069076:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff91 expref: 6 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141871.069118:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:0.0:1783141871.069127:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2368:x1869759492718208:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141871.069142:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141871.069149:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff91 expref: 6 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.069163:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff91 expref: 6 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.069184:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da898fee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff91 expref: 6 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.069201:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141871.069206:0:7493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.069215:0:7493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.069223:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783141871.069227:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783141871.069261:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141871.069278:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.069285:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141871.069321:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2368:x1869759492718208:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 194us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141871.069329:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00010000:00010000:3.0:1783141871.069427:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.069438:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.069447:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141871.073884:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783141871.073902:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.073911:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.073918:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.073923:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141871.073928:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.073947:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.073963:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141871.073966:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.073971:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.073976:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89902d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141871.073994:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096b820b5 reply state 0000000087cb0f77 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141871.074002:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141871.074087:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:11310:x1869759492718080:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 28318us (28709us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1783141871.074096:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 140 00010000:00010000:2.0:1783141871.080119:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.080135:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.080142:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.080147:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141871.080151:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.080158:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.080193:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff946489eed300) 00010000:00010000:2.0:1783141871.080197:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141871.080201:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.080208:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899034 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141871.164589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141871.164726:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492718336 00000100:00100000:2.0:1783141871.164736:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492718336 00000100:00100000:2.0:1783141871.164787:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 141 00000100:00100000:2.0:1783141871.164797:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:11319:x1869759492718336:12345-192.168.203.27@tcp:101:lctl.0 00010000:00010000:2.0:1783141871.164819:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141871.164840:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89903b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffa6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.164905:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da899042 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.164920:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da899042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.164931:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da899042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141871.164989:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783141871.164993:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141871.165017:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da899042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.165056:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89903b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffa6 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.165074:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da899042 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffa6 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.165083:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722d00) 00010000:00010000:2.0:1783141871.165086:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141871.165089:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1400, rc 0) 00000100:00100000:2.0:1783141871.165148:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:11319:x1869759492718336:12345-192.168.203.27@tcp:101:lctl.0 Request processed in 352us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141871.165165:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 141 00000100:00100000:3.0:1783141871.238663:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141871.238741:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492718464 00000100:00100000:2.0:1783141871.238751:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492718464 00000100:00100000:2.0:1783141871.238912:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 142 00000100:00100000:2.0:1783141871.238924:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+15:11325:x1869759492718464:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1783141871.238946:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141871.238966:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da899049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffad expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239028:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239041:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239051:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239080:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239088:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239096:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239274:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da89905e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239283:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da89905e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239289:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da89905e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141871.239336:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1783141871.239340:0:10143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141871.239362:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da89905e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239373:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239379:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239385:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239400:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141871.239404:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239411:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239423:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722d00) 00010000:00010000:2.0:1783141871.239426:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141871.239430:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239436:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899050 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239449:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239456:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239520:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239533:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141871.239537:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239546:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239564:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94648c722e00) 00010000:00010000:2.0:1783141871.239566:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141871.239569:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239574:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899057 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239606:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da899049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffad expref: 17 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239618:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da89905e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffad expref: 16 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.239624:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141871.239626:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783141871.239629:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1600, rc 0) 00000100:00100000:3.0:1783141871.240197:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:11325:x1869759492718464:12345-192.168.203.27@tcp:101:bash.0 Request processed in 1273us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141871.240206:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 142 00000100:00100000:1.0:1783141871.243485:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.243664:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492718720 00000100:00100000:3.0:1783141871.243674:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492718720 00000100:00100000:3.0:1783141871.243798:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:3.0:1783141871.243810:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464974e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+16:11325:x1869759492718720:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141871.246816:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141871.246866:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899065 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.247025:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.247167:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.247179:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.247244:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.247261:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.247267:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783141871.248869:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1783141871.249954:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.249972:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250196:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250246:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250276:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250283:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250289:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141871.250294:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250301:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250314:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:3.0:1783141871.250317:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.250321:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250328:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da89906c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141871.250343:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e9f0fb3e reply state 00000000ba921bbd transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141871.250351:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783141871.250391:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899065 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffb4 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250406:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffb4 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.250425:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946489eeda00) 00010000:00010000:3.0:1783141871.250427:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141871.250430:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2043400, rc 0) 00000100:00100000:3.0:1783141871.250622:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464974e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:11325:x1869759492718720:12345-192.168.203.27@tcp:101:bash.0 Request processed in 6813us (7170us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1783141871.250631:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 143 00010000:00010000:1.0:1783141871.256403:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.256421:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.256428:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.256435:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141871.256440:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.256449:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.256526:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946489eed100) 00010000:00010000:1.0:1783141871.256529:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141871.256534:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.256540:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174a00/0x279ffa91da899073 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141871.256883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141871.258172:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492718848 00000100:00100000:2.0:1783141871.258188:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492718848 00000100:00100000:1.0:1783141871.258296:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:1.0:1783141871.258309:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492718848:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1783141871.258326:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141871.258348:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffbb expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141871.258374:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141871.258391:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1783141871.258396:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141871.258405:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffbb expref: 6 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.258424:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffbb expref: 6 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.258441:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53e00, rc 0) 00000100:00100000:1.0:1783141871.258521:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2367:x1869759492718848:12345-192.168.203.27@tcp:101:bash.0 Request processed in 216us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141871.258549:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00080000:0.0:1783141871.259773:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141871.261734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.262024:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492718976 00000100:00100000:3.0:1783141871.262094:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492718976 00000100:00100000:3.0:1783141871.262203:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:3.0:1783141871.262216:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:11325:x1869759492718976:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141871.262233:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141871.262259:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffc2 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.262290:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffbb expref: 7 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.262299:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141871.262303:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141871.262308:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.262446:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffbb expref: 7 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.262709:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffbb expref: 7 pid: 6586 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141871.262725:0:6584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464bfc5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6584:1869759510549760:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141871.262821:0:6584:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a34cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141871.265736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141871.265859:0:6584:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464bfc5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6584:1869759510549760:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141871.265893:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.265914:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464814a6000, rc 0) 00000100:00100000:0.0:1783141871.265974:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:11325:x1869759492718976:12345-192.168.203.27@tcp:101:bash.0 Request processed in 3761us (4248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141871.265984:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:1.0:1783141871.266796:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492719104 00000100:00100000:1.0:1783141871.266805:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492719104 00010000:00010000:1.0:1783141871.266840:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffbb expref: 7 pid: 6586 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141871.266877:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:1.0:1783141871.266887:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2368:x1869759492719104:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141871.266900:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141871.266920:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffbb expref: 7 pid: 6586 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.266932:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffbb expref: 7 pid: 6586 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.266954:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da899088 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffbb expref: 7 pid: 6586 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.266969:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141871.266973:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141871.266981:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.266991:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.267058:0:6600:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141871.267072:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba9eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6600:1869759510549888:192.168.203.27@tcp:105: 00000100:00100000:1.0:1783141871.267134:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464852e3180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141871.275101:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba9eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6600:1869759510549888:192.168.203.27@tcp:105: 00010000:00010000:3.0:1783141871.275128:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141871.275194:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492719104:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 8308us (9467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141871.275206:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:2.0:1783141871.278559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.278682:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492719360 00000100:00100000:3.0:1783141871.278691:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492719360 00000100:00100000:3.0:1783141871.278742:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:3.0:1783141871.278751:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:11325:x1869759492719360:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:3.0:1783141871.279142:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:11325:x1869759492719360:12345-192.168.203.27@tcp:35:bash.0 Request processed in 391us (592us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1783141871.279158:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00010000:00010000:1.0:1783141871.322641:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141871.354966:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141871.355270:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492719616 00000100:00100000:0.0:1783141871.355280:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492719616 00000100:00100000:0.0:1783141871.355336:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00100000:0.0:1783141871.355346:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:11335:x1869759492719616:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141871.355372:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141871.355392:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da899096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffc9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141871.355541:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783141871.355650:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da899096 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc9 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.355664:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722d00) 00010000:00010000:0.0:1783141871.355679:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141871.355686:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da899096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc9 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.355699:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6c00, rc 0) 00000100:00100000:0.0:1783141871.355752:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11335:x1869759492719616:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 407us (796us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1783141871.355760:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00100000:0.0:1783141871.358646:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141871.358724:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492719872 00000100:00100000:1.0:1783141871.358735:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492719872 00000100:00100000:1.0:1783141871.358796:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:1.0:1783141871.358807:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11335:x1869759492719872:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1783141871.359091:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:11335:x1869759492719872:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 285us (454us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1783141871.359099:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:2.0:1783141871.434400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.439376:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492720000 00000100:00100000:3.0:1783141871.439391:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492720000 00000100:00100000:0.0:1783141871.441016:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00100000:0.0:1783141871.441031:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:11341:x1869759492720000:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141871.441057:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141871.441079:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8990a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffd0 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.441143:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8990ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.441156:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8990ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.441166:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8990ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141871.441230:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1783141871.441234:0:10143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141871.441271:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8990ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.441395:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8990a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffd0 expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.441425:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8990ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffd0 expref: 22 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.441434:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:0.0:1783141871.441437:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141871.441440:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7a00, rc 0) 00000100:00100000:0.0:1783141871.441942:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:11341:x1869759492720000:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 913us (7551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141871.441950:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00100000:0.0:1783141871.448967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.449079:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492720256 00000100:00100000:3.0:1783141871.449089:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492720256 00000100:00100000:3.0:1783141871.449145:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 146 00000100:00100000:3.0:1783141871.449155:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:11341:x1869759492720256:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141871.449187:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141871.449206:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da8990b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffd7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.449389:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16000/0x279ffa91da8990b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.449403:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16000/0x279ffa91da8990b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.449414:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16000/0x279ffa91da8990b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141871.449425:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783141871.449650:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7000/0x279ffa91da8990b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffd7 expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.449670:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16000/0x279ffa91da8990b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffd7 expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.449678:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946489eeda00) 00010000:00010000:3.0:1783141871.449681:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141871.449685:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16000, rc 0) 00000100:00100000:3.0:1783141871.450078:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11341:x1869759492720256:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 923us (1119us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1783141871.450086:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 146 00000100:00100000:1.0:1783141871.455434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141871.455512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141871.455544:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492720640 00000100:00100000:1.0:1783141871.455553:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492720640 00000100:00100000:0.0:1783141871.455657:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492720512 00000100:00100000:0.0:1783141871.455662:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492720512 00000100:00100000:0.0:1783141871.455721:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00100000:0.0:1783141871.455731:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11341:x1869759492720512:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141871.455754:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141871.455775:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8990c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffde expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.456071:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.456087:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.456098:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141871.456128:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783141871.456391:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8990c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffde expref: 27 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.456409:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffde expref: 26 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.456419:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946489eeda00) 00010000:00010000:0.0:1783141871.456421:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783141871.456425:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6a00, rc 0) 00000100:00100000:0.0:1783141871.456508:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:11341:x1869759492720512:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 778us (1082us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1783141871.456516:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00100000:1.0:1783141871.456683:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:1.0:1783141871.456692:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:2368:x1869759492720640:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141871.456768:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141871.456785:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16000/0x279ffa91da8990b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffd7 expref: 26 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141871.456807:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946489eeda00) 00010000:00010000:1.0:1783141871.456810:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141871.456830:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+25:2368:x1869759492720640:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 139us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141871.456836:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:2.0:1783141871.463768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141871.463914:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492720768 00000100:00100000:0.0:1783141871.463924:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492720768 00000100:00100000:0.0:1783141871.463974:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:0.0:1783141871.463984:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492720768:12345-192.168.203.27@tcp:1:lfs.0 00010000:00010000:0.0:1783141871.464025:0:10144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.464045:0:10144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.464053:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141871.464057:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141871.464061:0:10144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.464110:0:10144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.464123:0:10144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 6 pid: 6584 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141871.464137:0:10144:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10144:1869759510550016:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141871.464231:0:10144:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464969d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141871.466513:0:10144:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10144:1869759510550016:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141871.466540:0:10144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141871.468257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141871.468582:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492720896 00000100:00100000:0.0:1783141871.468592:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492720896 00002000:00100000:0.0:1783141871.468637:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9464ba66aa00 x1869759492720896/t0(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:247/0 lens 504/0 e 0 to 0 dl 1783141882 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141871.468648:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464ba66aa00 with x1869759492720896 ext(0->12) 00010000:00010000:0.0:1783141871.468656:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 7 pid: 6584 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.468672:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 7 pid: 6584 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141871.468680:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9464ba66aa00 00000100:00100000:0.0:1783141871.468734:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:0.0:1783141871.468743:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2368:x1869759492720896:12345-192.168.203.27@tcp:4:lfs.0 00000100:00100000:0.0:1783141871.469245:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2368:x1869759492720896:12345-192.168.203.27@tcp:4:lfs.0 Request processed in 500us (1000us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783141871.469263:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00002000:00100000:0.0:1783141871.469270:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9464ba66aa00 x1869759492720896/t4294967305(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:247/0 lens 504/448 e 0 to 0 dl 1783141882 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141871.469278:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9464ba66aa00 with x1869759492720896 ext(0->12) 00010000:00010000:0.0:1783141871.469284:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 9 pid: 6584 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.470422:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 9 pid: 6584 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141871.470434:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9464ba66aa00 00000100:00100000:1.0:1783141871.473071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141871.473164:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492721024 00000100:00100000:2.0:1783141871.473175:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492721024 00010000:00010000:2.0:1783141871.473213:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 9 pid: 6584 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141871.473398:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:2.0:1783141871.473411:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2366:x1869759492721024:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141871.473426:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783141871.473443:0:5774:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783141871.473446:0:5774:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783141870 00002000:00010000:2.0:1783141871.473448:0:5774:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783141871 00002000:00010000:2.0:1783141871.473450:0:5774:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783141870 00010000:00010000:2.0:1783141871.473456:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 9 pid: 6584 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.473511:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 9 pid: 6584 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.473533:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0a4a257/0x279ffa91da89908f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffc2 expref: 9 pid: 6584 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.473550:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141871.473554:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141871.473560:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.473571:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.473596:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141871.473707:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2366:x1869759492721024:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 291us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141871.473715:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 62 00010000:00010000:0.0:1783141871.474437:0:10144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.474448:0:10144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.474496:0:10144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.474505:0:10144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.474524:0:10144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.474530:0:10144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141871.474534:0:10144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.474543:0:10144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.474559:0:10144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.474567:0:10144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da8990dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141871.474619:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492720768:12345-192.168.203.27@tcp:1:lfs.0 Request processed in 10636us (10861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141871.474625:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:1.0:1783141871.481980:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.482100:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492721280 00000100:00100000:3.0:1783141871.482113:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492721280 00000100:00100000:3.0:1783141871.482289:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:3.0:1783141871.482318:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+25:11341:x1869759492721280:12345-192.168.203.27@tcp:35:lfs.0 00000004:00010000:3.0:1783141871.482405:0:5790:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffde expref: 25 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783141871.483093:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1783141871.483140:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1783141871.484527:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1783141871.484900:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.484924:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffb4 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.484933:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.484986:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffb4 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.485004:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffb4 expref: 29 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141871.485022:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497265f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1869759510550144:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141871.485215:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141871.497931:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497265f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1869759510550144:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141871.497977:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141871.505877:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.506530:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492721408 00000100:00100000:3.0:1783141871.506555:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492721408 00010000:00010000:3.0:1783141871.506898:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffb4 expref: 30 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141871.506954:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:3.0:1783141871.506967:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:2368:x1869759492721408:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141871.506988:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141871.506998:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffb4 expref: 30 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.507014:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffb4 expref: 30 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.507041:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2043400/0x279ffa91da89907a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffb4 expref: 30 pid: 5786 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.507084:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946489eeda00) 00010000:00010000:3.0:1783141871.507092:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.507103:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.507112:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.507522:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141871.507688:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.507699:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141871.507830:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:2368:x1869759492721408:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 863us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141871.507839:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 63 00000001:00080000:2.0:1783141871.507876:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1783141871.508155:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1783141871.508312:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba669c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510550272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783141871.513125:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141871.513190:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff946481370f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141871.514588:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510550272 00000100:00100000:3.0:1783141871.514600:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510550272 00000100:00100000:3.0:1783141871.514669:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783141871.514678:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1869759510550272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1783141871.514764:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141871.514788:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1869759510550272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141871.514795:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141871.515337:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba669c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510550272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783141871.516063:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1783141871.516142:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946489d54e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510550400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783141871.516189:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141871.516352:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1783141871.522475:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510550400 00000100:00100000:3.0:1783141871.522489:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510550400 00000100:00100000:2.0:1783141871.522639:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141871.522650:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1869759510550400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783141871.522906:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5790:x1869759510550400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 257us (6715us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783141871.522915:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783141871.523018:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946489d54e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510550400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783141871.523098:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1783141871.523149:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.523160:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.523180:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.523186:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141871.523191:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.523199:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.523215:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946489eeda00) 00010000:00010000:0.0:1783141871.523218:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783141871.523222:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.523228:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16e00/0x279ffa91da8990e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141871.523426:0:5790:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783141871.523551:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1783141871.523561:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378728100438ns, next at 379728098673ns, rc = 0 00000001:00080000:0.0:1783141871.523567:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1783141871.523595:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946489eeda00) 00010000:00010000:0.0:1783141871.523598:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783141871.523606:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffde expref: 33 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141871.523714:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11341:x1869759492721280:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 41398us (41748us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1783141871.523739:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00000020:00080000:0.0:1783141871.523745:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783141871.536573:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141871.536728:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492721536 00000100:00100000:0.0:1783141871.536741:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492721536 00000100:00100000:0.0:1783141871.536813:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:0.0:1783141871.536826:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11341:x1869759492721536:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141871.536857:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141871.536887:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffe5 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.536971:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffe5 expref: 33 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.536989:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffe5 expref: 33 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.537013:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141871.537016:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141871.537020:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6a00, rc 0) 00000100:00100000:0.0:1783141871.537096:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:11341:x1869759492721536:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 273us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141871.537104:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:1.0:1783141871.541039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141871.545618:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492721792 00000100:00100000:2.0:1783141871.545634:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492721792 00000100:00100000:2.0:1783141871.545916:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:2.0:1783141871.545927:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:11341:x1869759492721792:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1783141871.548837:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:11341:x1869759492721792:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 2900us (7797us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1783141871.548852:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:0.0:1783141871.643418:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141871.645167:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492722048 00000100:00100000:2.0:1783141871.645185:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492722048 00000100:00100000:2.0:1783141871.645395:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 149 00000100:00100000:2.0:1783141871.645411:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:11351:x1869759492722048:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141871.645451:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141871.645502:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8990f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99ffec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141871.645642:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783141871.645835:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8990f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffec expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.645853:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722d00) 00010000:00010000:2.0:1783141871.645856:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141871.645862:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8990f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffec expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.645889:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1800, rc 0) 00000100:00100000:2.0:1783141871.645974:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11351:x1869759492722048:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 570us (2572us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1783141871.645982:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 149 00000100:00100000:2.0:1783141871.657984:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.664497:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492722176 00000100:00100000:3.0:1783141871.664524:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492722176 00000100:00100000:3.0:1783141871.665112:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 150 00000100:00100000:3.0:1783141871.665128:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11351:x1869759492722176:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:3.0:1783141871.665214:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.665231:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.665243:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.665269:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.665276:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.665311:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.667885:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.667995:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668007:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141871.668060:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668074:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668081:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668089:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668095:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141871.668099:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668107:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668120:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:3.0:1783141871.668133:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.668138:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668144:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da8990ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668220:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668226:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668231:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668236:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141871.668238:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668243:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668264:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946489eede00) 00010000:00010000:3.0:1783141871.668268:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.668271:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668277:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668295:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668308:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668314:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668320:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141871.668323:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668330:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668338:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141871.668341:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.668344:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.668350:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89910d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141871.668811:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11351:x1869759492722176:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 3681us (10832us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141871.668821:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 150 00000100:00100000:0.0:1783141871.679951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141871.680022:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492722432 00000100:00100000:2.0:1783141871.680051:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492722432 00000100:00100000:2.0:1783141871.680133:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:2.0:1783141871.680147:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11351:x1869759492722432:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1783141871.680662:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:11351:x1869759492722432:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 516us (718us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1783141871.680671:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 40 00000001:00080000:1.0:1783141871.712704:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967431 is committed 00000004:00080000:1.0:1783141871.712718:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:1.0:1783141871.712752:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000020:00080000:1.0:1783141871.712762:0:5809:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946481370600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1783141871.712768:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff94649d1ab700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946489a47240 00000020:00080000:1.0:1783141871.712771:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff94649d1aba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9464ba9dbc00 00000020:00080000:2.0:1783141871.712919:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1783141871.713135:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1783141871.713689:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510550528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783141871.713752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141871.713978:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510550528 00000100:00100000:0.0:1783141871.713985:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510550528 00000100:00100000:0.0:1783141871.714039:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783141871.714062:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1869759510550528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783141871.714090:0:6587:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1783141871.714133:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a4895ee, atime: 0x6a4895ef, ctime: 0x6a4895ee, blocks: 0x1 00010000:00010000:0.0:1783141871.714141:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.714171:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1783141871.714175:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141871.714182:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.714197:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.714208:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.714225:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.714257:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783141871.715499:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141871.715509:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.715520:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141871.715525:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.715535:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.715552:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.715559:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918e81a4/0x279ffa91da899114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141871.715579:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141871.715581:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141871.715591:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141871.720864:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1869759510550528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6792us (7098us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783141871.720878:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1783141871.721035:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946496b19c00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1783141871.721042:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510550528:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783141871.741315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141871.741602:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492722688 00000100:00100000:3.0:1783141871.741611:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492722688 00000100:00100000:3.0:1783141871.741671:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 151 00000100:00100000:3.0:1783141871.741693:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:11354:x1869759492722688:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141871.741719:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141871.741738:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89911b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fff3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.741811:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.741825:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.741836:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.741849:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.741856:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.741862:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742562:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742575:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742582:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141871.742605:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783141871.742700:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742707:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742713:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742719:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141871.742723:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742730:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742741:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:3.0:1783141871.742744:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.742749:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742754:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899122 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742766:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742772:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742788:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742793:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141871.742795:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742801:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742809:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946489eede00) 00010000:00010000:3.0:1783141871.742811:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141871.742814:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742819:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da899129 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742862:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89911b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fff3 expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742876:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fff3 expref: 20 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141871.742882:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141871.742884:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141871.742887:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17200, rc 0) 00000100:00100000:3.0:1783141871.742946:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11354:x1869759492722688:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1256us (1640us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1783141871.742963:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 151 00000100:00100000:3.0:1783141871.750938:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141871.751039:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492722816 00000100:00100000:0.0:1783141871.751048:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492722816 00000100:00100000:0.0:1783141871.751122:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00100000:0.0:1783141871.751133:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11354:x1869759492722816:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1783141871.751441:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.751517:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.751529:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.751556:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.751563:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.751569:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.751576:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141871.751580:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.751587:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.751598:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141871.751602:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141871.751606:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141871.751611:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89913e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141871.751678:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11354:x1869759492722816:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 545us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141871.751691:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00100000:0.0:1783141871.768655:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141871.769925:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492723072 00000100:00100000:2.0:1783141871.769938:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492723072 00000100:00100000:2.0:1783141871.769993:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:2.0:1783141871.770003:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11354:x1869759492723072:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1783141871.770276:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:11354:x1869759492723072:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 273us (1628us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1783141871.770284:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:2.0:1783141872.036532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141872.036949:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492723328 00000100:00100000:3.0:1783141872.036959:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492723328 00000100:00100000:3.0:1783141872.037020:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 153 00000100:00100000:3.0:1783141872.037031:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:11385:x1869759492723328:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:3.0:1783141872.037055:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141872.037074:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da899145 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e99fffa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.037367:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da89914c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.037383:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da89914c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.037397:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da89914c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141872.037409:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783141872.037558:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da899145 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fffa expref: 24 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.037577:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da89914c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fffa expref: 23 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.037586:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141872.037589:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141872.037603:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17800, rc 0) 00000100:00100000:3.0:1783141872.037724:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:11385:x1869759492723328:12345-192.168.203.27@tcp:101:cat.0 Request processed in 694us (1202us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1783141872.037733:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 153 00000100:00100000:3.0:1783141872.049620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141872.050436:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141872.050580:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492723712 00000100:00100000:1.0:1783141872.050590:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492723712 00000100:00100000:1.0:1783141872.050662:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:1.0:1783141872.050686:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497261880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:2368:x1869759492723712:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141872.050711:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141872.050735:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17800/0x279ffa91da89914c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fffa expref: 23 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141872.050754:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:1.0:1783141872.050758:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141872.050814:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497261880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:2368:x1869759492723712:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 131us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141872.050822:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:2.0:1783141872.050984:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492723584 00000100:00100000:2.0:1783141872.050989:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492723584 00000100:00100000:2.0:1783141872.051044:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:2.0:1783141872.051051:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:11385:x1869759492723584:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:2.0:1783141872.051341:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:11385:x1869759492723584:12345-192.168.203.27@tcp:35:cat.0 Request processed in 289us (1729us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1783141872.051348:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:0.0:1783141872.119949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141872.120134:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492723968 00000100:00100000:2.0:1783141872.120145:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492723968 00000100:00100000:2.0:1783141872.120214:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 154 00000100:00100000:2.0:1783141872.120224:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:11391:x1869759492723968:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:2.0:1783141872.120260:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141872.120263:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783141872.120292:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8990ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffd0 expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.120312:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141872.120330:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141872.120345:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da89915a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0001 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.120442:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.120457:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fff3 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.120526:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.120562:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fff3 expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.120575:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fff3 expref: 23 pid: 5786 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141872.120588:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946489d55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510550656:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141872.120690:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899180 going to sleep for 11 seconds 00000100:00100000:2.0:1783141872.133333:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946489d55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510550656:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141872.133362:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141872.133641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141872.134032:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492724096 00000100:00100000:3.0:1783141872.134040:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492724096 00010000:00010000:3.0:1783141872.134077:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fff3 expref: 24 pid: 5786 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141872.134186:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:3.0:1783141872.134196:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:2369:x1869759492724096:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141872.134339:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141872.134348:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fff3 expref: 24 pid: 5786 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.134361:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fff3 expref: 24 pid: 5786 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.134383:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fff3 expref: 24 pid: 5786 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.134397:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141872.134403:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.134412:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.134444:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.134559:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141872.134615:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:2369:x1869759492724096:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 420us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141872.134623:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00010000:00010000:0.0:1783141872.137318:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.137334:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141872.137358:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783141872.137552:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da89915a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0001 expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.137573:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0001 expref: 23 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.137581:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141872.137584:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783141872.137587:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1800, rc 0) 00000100:00100000:0.0:1783141872.137646:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:11391:x1869759492723968:12345-192.168.203.27@tcp:101:dd.0 Request processed in 17424us (17706us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1783141872.137655:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 154 00000100:00100000:0.0:1783141872.139915:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141872.139994:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492724352 00000100:00100000:1.0:1783141872.140004:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492724352 00000100:00100000:1.0:1783141872.140064:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 155 00000100:00100000:1.0:1783141872.140074:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:11391:x1869759492724352:12345-192.168.203.27@tcp:36:dd.0 00010000:00010000:1.0:1783141872.140336:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141872.140353:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141872.140363:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141872.140413:0:10143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1783141872.140437:0:10143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000047ca952 reply state 0000000083052f25 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141872.140446:0:10143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141872.140552:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:11391:x1869759492724352:12345-192.168.203.27@tcp:36:dd.0 Request processed in 478us (650us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1783141872.140571:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 155 00000020:00080000:1.0:1783141872.140577:0:10143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783141872.144098:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.144120:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.144158:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.144164:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141872.144170:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.144179:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.144199:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:2.0:1783141872.144203:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141872.144208:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.144214:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89916f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141872.321310:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1783141872.321336:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:3.0:1783141872.347871:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141872.522407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141872.522597:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492724480 00000100:00100000:3.0:1783141872.522610:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492724480 00000100:00100000:3.0:1783141872.522684:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 156 00000100:00100000:3.0:1783141872.522697:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+25:11405:x1869759492724480:12345-192.168.203.27@tcp:101:stat.0 00010000:00010000:3.0:1783141872.522727:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141872.522754:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0008 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.522842:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.522860:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.522872:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.522888:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.522895:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.522918:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.523514:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.523531:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0001 expref: 26 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.523541:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.523585:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0001 expref: 26 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.523649:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0001 expref: 26 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141872.523668:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497261880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510550784:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141872.525196:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141872.529621:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141872.529705:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492724736 00000100:00100000:2.0:1783141872.529717:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492724736 00000100:00100000:2.0:1783141872.529793:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:2.0:1783141872.529805:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:5578:x1869759492724736:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783141872.530255:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:5578:x1869759492724736:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 450us (647us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1783141872.530265:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:3.0:1783141872.535115:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497261880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510550784:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141872.535231:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141872.539013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141872.539105:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492724864 00000100:00100000:3.0:1783141872.539119:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492724864 00010000:00010000:3.0:1783141872.539187:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0001 expref: 28 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141872.539266:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:3.0:1783141872.539278:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946488314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:2368:x1869759492724864:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141872.539298:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141872.539306:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0001 expref: 28 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.539319:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0001 expref: 28 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.539347:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899161 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0001 expref: 28 pid: 5787 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.539366:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141872.539373:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.539385:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.539392:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141872.539432:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141872.539558:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946488314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:2368:x1869759492724864:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 282us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141872.539567:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00010000:00010000:0.0:1783141872.540074:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540101:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141872.540176:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783141872.540182:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141872.540208:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540223:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540234:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540251:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540258:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540264:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141872.540268:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540276:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540289:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:0.0:1783141872.540292:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141872.540297:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540320:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17a00/0x279ffa91da89917d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540336:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540342:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540347:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540352:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141872.540355:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540360:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540369:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946489eede00) 00010000:00010000:0.0:1783141872.540371:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141872.540374:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540379:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16800/0x279ffa91da899184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540427:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0008 expref: 27 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540441:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0008 expref: 26 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.540455:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141872.540457:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141872.540519:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17c00, rc 0) 00000100:00100000:0.0:1783141872.540580:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:11405:x1869759492724480:12345-192.168.203.27@tcp:101:stat.0 Request processed in 17886us (18187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141872.540597:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 156 00000100:00100000:0.0:1783141872.625604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141872.625847:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492725120 00000100:00100000:2.0:1783141872.625860:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492725120 00000100:00100000:2.0:1783141872.625950:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 157 00000100:00100000:2.0:1783141872.625962:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:11411:x1869759492725120:12345-192.168.203.27@tcp:36:truncate.0 00010000:00010000:2.0:1783141872.626073:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141872.626109:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89918b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0008 expref: 26 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.626133:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:2.0:1783141872.626138:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141872.626772:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.626792:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.626805:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141872.626865:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1783141872.626889:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe4d541d reply state 00000000e0593825 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141872.626900:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141872.627666:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:11411:x1869759492725120:12345-192.168.203.27@tcp:36:truncate.0 Request processed in 1698us (2069us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1783141872.627677:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 157 00000020:00080000:2.0:1783141872.627686:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783141872.636839:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141872.636864:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141872.636874:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141872.636882:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141872.636889:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141872.636898:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141872.637249:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:1.0:1783141872.637253:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141872.637260:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141872.637268:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899192 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141872.667448:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510550912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141872.667573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141872.667686:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510550912 00000100:00100000:0.0:1783141872.667697:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510550912 00000100:00100000:0.0:1783141872.667756:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783141872.667767:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510550912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141872.667812:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1783141872.667864:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510550912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141872.667872:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783141872.667921:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1783141872.667928:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1783141872.667955:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946496b19c00, transno 4294967307 00000100:00100000:0.0:1783141872.667974:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464876e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510550912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141872.669613:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946489d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510551296:0@lo:400:kworker.0 00000100:00100000:1.0:1783141872.669711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141872.669776:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141872.669783:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946489d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510551424:0@lo:400:kworker.0 00000100:00100000:1.0:1783141872.669809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141872.669890:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946489d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510551040:0@lo:400:kworker.0 00000100:00100000:3.0:1783141872.669938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141872.669972:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946489d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510551552:0@lo:400:kworker.0 00000100:00100000:3.0:1783141872.670002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141872.670035:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783141872.670041:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946489d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510551168:0@lo:400:kworker.0 00000100:00100000:3.0:1783141872.670067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141872.670096:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510551552 00000100:00100000:3.0:1783141872.670105:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510551552 00000100:00100000:3.0:1783141872.670182:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783141872.670193:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510551552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141872.670266:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510551552:12345-0@lo:400:kworker.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141872.670273:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1783141872.670298:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141872.670335:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946489d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510551552:0@lo:400:kworker.0 00000100:00100000:1.0:1783141872.670688:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510551040 00000100:00100000:1.0:1783141872.670694:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510551040 00000100:00100000:1.0:1783141872.670738:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1783141872.670746:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510551040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141872.670790:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510551040:12345-0@lo:400:kworker.0 Request processed in 45us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141872.670797:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783141872.670979:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510551296 00000100:00100000:2.0:1783141872.670985:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510551296 00000100:00100000:2.0:1783141872.671036:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510551424 00000100:00100000:2.0:1783141872.671039:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510551424 00000100:00100000:2.0:1783141872.671060:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510551168 00000100:00100000:2.0:1783141872.671063:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510551168 00000100:00100000:2.0:1783141872.671077:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783141872.671099:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510551296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141872.671156:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510551296:12345-0@lo:400:kworker.0 Request processed in 59us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141872.671163:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783141872.671177:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783141872.671183:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510551424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141872.671212:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510551424:12345-0@lo:400:kworker.0 Request processed in 29us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141872.671217:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783141872.671229:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783141872.671235:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510551168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141872.671278:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510551168:12345-0@lo:400:kworker.0 Request processed in 43us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141872.671284:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1783141872.672022:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141872.672081:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946489d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510551424:0@lo:400:kworker.0 00000100:00100000:1.0:1783141872.672099:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946489d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510551296:0@lo:400:kworker.0 00000100:00100000:3.0:1783141872.672596:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946489d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510551168:0@lo:400:kworker.0 00000100:00100000:3.0:1783141872.672611:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946489d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510551040:0@lo:400:kworker.0 00000100:00100000:0.0:1783141872.827760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141872.827988:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492725248 00000100:00100000:2.0:1783141872.827997:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492725248 00000100:00100000:2.0:1783141872.828059:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 158 00000100:00100000:2.0:1783141872.828069:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:11425:x1869759492725248:12345-192.168.203.27@tcp:101:stat.0 00010000:00010000:2.0:1783141872.828099:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141872.828121:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899199 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a000f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828256:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828270:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828306:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828323:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828331:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828337:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828695:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828705:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828713:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141872.828748:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1783141872.828752:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141872.828775:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828786:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828796:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828811:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828817:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828823:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141872.828827:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828834:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828846:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141872.828849:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141872.828853:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828859:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8991a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828873:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828879:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828884:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828889:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141872.828899:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828906:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828913:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648c722a00) 00010000:00010000:2.0:1783141872.828916:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141872.828918:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828924:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8991a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828955:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899199 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a000f expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828968:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a000f expref: 28 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141872.828975:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:2.0:1783141872.828977:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141872.828980:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1c00, rc 0) 00000100:00100000:2.0:1783141872.829044:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:11425:x1869759492725248:12345-192.168.203.27@tcp:101:stat.0 Request processed in 976us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141872.829049:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 158 00000100:00100000:2.0:1783141872.864061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141872.864113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141872.864150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141872.864187:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141872.864282:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492725632 00000100:00100000:0.0:1783141872.864291:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492725632 00000100:00100000:0.0:1783141872.864351:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492725504 00000100:00100000:0.0:1783141872.864360:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492725504 00000100:00100000:0.0:1783141872.864383:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:0.0:1783141872.864393:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492725632:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141872.864449:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492725376 00000100:00100000:3.0:1783141872.864453:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492725376 00000100:00100000:0.0:1783141872.864495:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492725632:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 103us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141872.864503:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:3.0:1783141872.864505:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 293 00000100:00100000:3.0:1783141872.864512:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492725376:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141872.864518:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:0.0:1783141872.864523:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492725504:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141872.864539:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492725376:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141872.864544:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492725504:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 21us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141872.864545:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 293 00000100:00100000:0.0:1783141872.864549:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00080000:2.0:1783141872.864733:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141872.864922:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492725760 00000100:00100000:1.0:1783141872.864927:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492725760 00000100:00100000:1.0:1783141872.864994:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:1.0:1783141872.865002:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492725760:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141872.865046:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2369:x1869759492725760:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 45us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141872.865053:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:2.0:1783141872.920816:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141872.921200:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492726016 00000100:00100000:0.0:1783141872.921210:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492726016 00000100:00100000:0.0:1783141872.921277:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 159 00000100:00100000:0.0:1783141872.921289:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:11435:x1869759492726016:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141872.921308:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141872.921328:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8991b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0016 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141872.921611:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1783141872.921779:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8991b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0016 expref: 30 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.921794:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722d00) 00010000:00010000:0.0:1783141872.921797:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141872.921802:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8991b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0016 expref: 30 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141872.921823:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7a00, rc 0) 00000100:00100000:0.0:1783141872.922131:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:11435:x1869759492726016:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 843us (1323us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1783141872.922139:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 159 00000100:00100000:2.0:1783141872.929425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141872.929555:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492726272 00000100:00100000:0.0:1783141872.929565:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492726272 00000100:00100000:0.0:1783141872.929626:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:0.0:1783141872.929635:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:11435:x1869759492726272:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1783141872.930089:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:11435:x1869759492726272:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 452us (672us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1783141872.930097:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:1.0:1783141873.010022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141873.012134:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492726528 00000100:00100000:0.0:1783141873.012148:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492726528 00000100:00100000:0.0:1783141873.012302:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 160 00000100:00100000:0.0:1783141873.012315:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:11441:x1869759492726528:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1783141873.012337:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141873.012357:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8991c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a001d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.012524:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.012538:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a000f expref: 31 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.012564:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.012597:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a000f expref: 31 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.012611:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a000f expref: 31 pid: 5786 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141873.012624:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94649744f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510551680:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141873.012794:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464969d79c0 going to sleep for 11 seconds 00000100:00080000:2.0:1783141873.013126:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141873.017367:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141873.018424:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492726656 00000100:00100000:3.0:1783141873.018448:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492726656 00010000:00010000:3.0:1783141873.018515:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a000f expref: 32 pid: 5786 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141873.019179:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:3.0:1783141873.019196:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:2369:x1869759492726656:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141873.019214:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141873.019222:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a000f expref: 32 pid: 5786 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.019250:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a000f expref: 32 pid: 5786 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.019273:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141873.019279:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.019288:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.019296:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.019325:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141873.019399:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:2369:x1869759492726656:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 206us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141873.019407:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 66 00010000:00010000:0.0:1783141873.019773:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8991ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a000f expref: 31 pid: 5786 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141873.019790:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94649744f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510551680:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141873.019812:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.019821:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.019833:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141873.019851:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1783141873.019996:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8991c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a001d expref: 32 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.020028:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a001d expref: 31 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.020035:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141873.020266:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783141873.020270:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7800, rc 0) 00000100:00100000:0.0:1783141873.020327:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+31:11441:x1869759492726528:12345-192.168.203.27@tcp:101:bash.0 Request processed in 8015us (10313us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1783141873.020335:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 160 00000100:00100000:2.0:1783141873.025173:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141873.025371:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492726912 00000100:00100000:1.0:1783141873.025380:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492726912 00000100:00100000:1.0:1783141873.025434:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 161 00000100:00100000:1.0:1783141873.025443:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+31:11441:x1869759492726912:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:1.0:1783141873.026132:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.026150:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.026162:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141873.026218:0:10143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1783141873.026257:0:10143:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000842ef7c0 reply state 00000000b9c74b67 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141873.026266:0:10143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141873.026376:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:11441:x1869759492726912:12345-192.168.203.27@tcp:36:bash.0 Request processed in 932us (1211us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1783141873.026383:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 161 00000020:00080000:1.0:1783141873.026388:0:10143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783141873.032557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00010000:00010000:0.0:1783141873.032560:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.032572:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.032580:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.032586:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141873.032590:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.032598:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.032616:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141873.032619:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141873.032624:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141873.032640:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492727040 00010000:00010000:0.0:1783141873.032643:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8991d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141873.032649:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492727040 00000100:00100000:1.0:1783141873.032699:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 162 00000100:00100000:1.0:1783141873.032708:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:11441:x1869759492727040:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1783141873.032730:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141873.032745:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8991df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0024 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.032822:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.032835:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a001d expref: 34 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.032851:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.032883:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a001d expref: 34 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.032898:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a001d expref: 34 pid: 5787 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141873.032911:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba8fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510551808:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141873.032988:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649683f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141873.036348:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba8fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510551808:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141873.036376:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141873.037074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141873.037693:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492727168 00000100:00100000:3.0:1783141873.037703:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492727168 00010000:00010000:3.0:1783141873.037753:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a001d expref: 35 pid: 5787 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141873.037798:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:3.0:1783141873.037808:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:2368:x1869759492727168:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141873.037823:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141873.037831:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a001d expref: 35 pid: 5787 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.037843:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a001d expref: 35 pid: 5787 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.037863:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da8991ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a001d expref: 35 pid: 5787 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.037879:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141873.037885:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.037894:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.037902:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.037966:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141873.038020:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:2368:x1869759492727168:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 213us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141873.038028:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 67 00010000:00010000:0.0:1783141873.039786:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.039800:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141873.039852:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783141873.039856:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141873.039879:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.039915:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8991df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0024 expref: 34 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.039932:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0024 expref: 33 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.039940:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141873.039943:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141873.039945:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52400, rc 0) 00000100:00100000:0.0:1783141873.040056:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:11441:x1869759492727040:12345-192.168.203.27@tcp:101:bash.0 Request processed in 7348us (7507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141873.040064:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 162 00000100:00100000:3.0:1783141873.043235:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141873.043328:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492727424 00000100:00100000:0.0:1783141873.043337:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492727424 00000100:00100000:0.0:1783141873.043431:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:0.0:1783141873.043497:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:11441:x1869759492727424:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:0.0:1783141873.043724:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:11441:x1869759492727424:12345-192.168.203.27@tcp:35:bash.0 Request processed in 267us (495us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1783141873.043732:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:2.0:1783141873.161850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141873.163362:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492727680 00000100:00100000:0.0:1783141873.163383:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492727680 00000100:00100000:0.0:1783141873.163452:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 163 00000100:00100000:0.0:1783141873.163494:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:11451:x1869759492727680:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141873.163518:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141873.163538:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8991ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a002b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141873.163788:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1783141873.163954:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8991ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a002b expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.163969:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722d00) 00010000:00010000:0.0:1783141873.163972:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141873.163978:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8991ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a002b expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.163991:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7a00, rc 0) 00000100:00100000:0.0:1783141873.164060:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11451:x1869759492727680:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 600us (2218us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1783141873.164067:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 163 00000100:00100000:3.0:1783141873.166437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141873.166519:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492727808 00000100:00100000:1.0:1783141873.166528:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492727808 00000100:00100000:1.0:1783141873.166582:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:1.0:1783141873.166592:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11451:x1869759492727808:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:1.0:1783141873.166660:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.166678:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.166689:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.166720:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.166728:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.166735:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167055:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167066:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167073:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141873.167113:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167125:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167131:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167138:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167144:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141873.167149:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167163:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167174:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:1.0:1783141873.167177:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141873.167182:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167188:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8991fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167201:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167207:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167212:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167217:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141873.167219:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167225:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167231:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648becae00) 00010000:00010000:1.0:1783141873.167233:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141873.167246:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167261:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167276:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167287:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167293:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167298:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141873.167301:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167307:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167315:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:1.0:1783141873.167318:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141873.167321:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.167327:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141873.169384:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11451:x1869759492727808:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 2443us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141873.169399:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 164 00000100:00100000:3.0:1783141873.173848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141873.174014:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492728064 00000100:00100000:1.0:1783141873.174025:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492728064 00000100:00100000:1.0:1783141873.174081:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:1.0:1783141873.174091:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11451:x1869759492728064:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1783141873.175729:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:11451:x1869759492728064:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 1631us (1881us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1783141873.175742:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:0.0:1783141873.179010:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510551936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141873.179093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141873.179457:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510551936 00000100:00100000:1.0:1783141873.179488:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510551936 00000100:00100000:1.0:1783141873.179529:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783141873.179702:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649744f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510551936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141873.179736:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141873.180100:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649744f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510551936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 400us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141873.180108:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783141873.180411:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510551936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141873.260868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141873.261667:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492728320 00000100:00100000:0.0:1783141873.261680:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492728320 00000100:00100000:0.0:1783141873.261745:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 165 00000100:00100000:0.0:1783141873.261755:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:11454:x1869759492728320:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141873.261778:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141873.261798:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899210 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0032 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.261873:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.261888:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.261899:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.261913:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.261921:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.261927:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262327:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da899225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262348:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da899225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262356:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da899225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141873.262367:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783141873.262574:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262583:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262590:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262596:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141873.262600:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262609:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262622:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:0.0:1783141873.262625:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141873.262630:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262635:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899217 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262647:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262659:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262665:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262671:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141873.262674:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262680:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262689:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648a1ada00) 00010000:00010000:0.0:1783141873.262691:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141873.262694:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262699:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da89921e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262743:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899210 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0032 expref: 39 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262757:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da899225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0032 expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.262764:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141873.262766:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141873.262775:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6c00, rc 0) 00000100:00100000:0.0:1783141873.262844:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:11454:x1869759492728320:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1090us (1986us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1783141873.262854:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 165 00000100:00100000:3.0:1783141873.274776:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141873.274871:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492728448 00000100:00100000:2.0:1783141873.274880:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492728448 00000100:00100000:2.0:1783141873.274951:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 166 00000100:00100000:2.0:1783141873.274959:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:11454:x1869759492728448:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:2.0:1783141873.275031:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.275047:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.275057:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.275080:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.275086:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.275093:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.275845:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141873.275851:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.275859:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.275874:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:2.0:1783141873.275877:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141873.275880:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.275887:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141873.276176:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:11454:x1869759492728448:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 1215us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141873.276185:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 166 00000100:00100000:3.0:1783141873.276700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141873.276805:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492728576 00000100:00100000:1.0:1783141873.276812:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492728576 00000100:00100000:1.0:1783141873.276900:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:1.0:1783141873.276908:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:2367:x1869759492728576:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141873.276921:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141873.276947:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da899225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0032 expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.276960:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:1.0:1783141873.276964:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141873.277008:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+37:2367:x1869759492728576:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141873.277022:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:2.0:1783141873.278593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141873.278667:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492728832 00000100:00100000:3.0:1783141873.278677:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492728832 00000100:00100000:3.0:1783141873.278731:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:3.0:1783141873.278742:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+37:11454:x1869759492728832:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1783141873.278990:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:11454:x1869759492728832:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 249us (403us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1783141873.278997:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00010000:00010000:1.0:1783141873.370632:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141873.436675:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141873.436823:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492729088 00000100:00100000:1.0:1783141873.436837:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492729088 00000100:00100000:1.0:1783141873.436915:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 167 00000100:00100000:1.0:1783141873.436927:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:11472:x1869759492729088:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:1.0:1783141873.436949:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141873.436968:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89923a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0039 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.437065:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899241 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.437079:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899241 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.437089:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899241 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141873.437110:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783141873.437247:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da89923a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0039 expref: 41 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.437268:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899241 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0039 expref: 40 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141873.437277:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:1.0:1783141873.437281:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783141873.437297:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52200, rc 0) 00000100:00100000:1.0:1783141873.437365:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11472:x1869759492729088:12345-192.168.203.27@tcp:101:cat.0 Request processed in 441us (706us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1783141873.437372:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 167 00000100:00100000:3.0:1783141873.457035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141873.457300:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492729216 00000100:00100000:2.0:1783141873.457316:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492729216 00000100:00100000:2.0:1783141873.457389:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 168 00000100:00100000:2.0:1783141873.457399:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baa21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11473:x1869759492729216:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141873.457422:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141873.457441:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89924f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0040 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.457550:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.457577:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.457588:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141873.457799:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783141873.457804:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141873.457884:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.457922:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89924f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0040 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.457938:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0040 expref: 41 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.457946:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141873.457949:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141873.457952:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0e00, rc 0) 00000100:00100000:2.0:1783141873.458017:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baa21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:11473:x1869759492729216:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 619us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141873.458024:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 168 00000100:00100000:2.0:1783141873.467980:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141873.468064:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492729600 00000100:00100000:3.0:1783141873.468076:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492729600 00000100:00100000:3.0:1783141873.468218:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:3.0:1783141873.468232:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:11473:x1869759492729600:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1783141873.468703:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:11473:x1869759492729600:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 472us (733us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1783141873.470507:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:3.0:1783141873.472730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141873.473121:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492729728 00000100:00100000:2.0:1783141873.473145:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492729728 00000100:00100000:2.0:1783141873.473226:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1783141873.473248:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:11473:x1869759492729728:12345-192.168.203.27@tcp:103:lfs.0 00010000:00010000:2.0:1783141873.473279:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783141873.473430:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8991e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0024 expref: 42 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.473516:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899241 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0039 expref: 41 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.473532:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da8990ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffe5 expref: 40 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.473544:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:2.0:1783141873.473556:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141873.473632:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:11473:x1869759492729728:12345-192.168.203.27@tcp:103:lfs.0 Request processed in 395us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141873.473641:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:0.0:1783141873.475868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141873.476203:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492729856 00000100:00100000:2.0:1783141873.476215:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492729856 00000100:00100000:2.0:1783141873.476294:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 169 00000100:00100000:2.0:1783141873.476307:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:11473:x1869759492729856:12345-192.168.203.27@tcp:58:lfs.0 00010000:00010000:2.0:1783141873.476446:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.476487:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.476500:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141873.477704:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1783141873.477904:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:11473:x1869759492729856:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 1594us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141873.477916:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 169 00000100:00100000:1.0:1783141873.505803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141873.506037:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492729984 00000100:00100000:0.0:1783141873.506047:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492729984 00000100:00100000:0.0:1783141873.506117:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 170 00000100:00100000:0.0:1783141873.506126:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:11475:x1869759492729984:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141873.506146:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141873.506167:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899264 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0047 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.506229:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.506256:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.506267:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.506282:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.506289:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.506295:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.506883:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.506962:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.506970:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141873.507007:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783141873.507011:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141873.507030:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507041:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507049:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507055:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507062:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507067:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141873.507072:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507079:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507531:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:0.0:1783141873.507536:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141873.507541:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507548:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da89926b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507564:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507570:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507576:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507581:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141873.507584:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507591:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507598:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648a1ada00) 00010000:00010000:0.0:1783141873.507600:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141873.507603:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507609:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899272 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507659:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899264 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0047 expref: 41 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507673:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0047 expref: 40 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.507680:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648c722a00) 00010000:00010000:0.0:1783141873.507682:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141873.507947:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6a00, rc 0) 00000100:00100000:0.0:1783141873.508086:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11475:x1869759492729984:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1960us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141873.508094:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 170 00000040:00080000:3.0:1783141873.947385:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141873.947398:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141873.947499:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1783141873.947509:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141873.947678:0:11546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971da300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510552064:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783141873.948923:0:11546:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464877dc180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141873.958924:0:11546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971da300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510552064:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783141873.959366:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141873.959692:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492730112 00000100:00100000:3.0:1783141873.959701:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492730112 00000100:00100000:3.0:1783141873.959785:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 171 00000100:00100000:3.0:1783141873.959796:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11486:x1869759492730112:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783141873.959838:0:7171:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783141873.959992:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11486:x1869759492730112:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 196us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141873.960003:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 171 00000100:00100000:0.0:1783141873.966399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141873.966510:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492730240 00000100:00100000:3.0:1783141873.966522:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492730240 00000100:00100000:3.0:1783141873.966593:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 172 00000100:00100000:3.0:1783141873.966605:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11486:x1869759492730240:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783141873.966700:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966719:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966735:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966752:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966760:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966784:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966819:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966828:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966836:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141873.966883:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783141873.966888:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783141873.966902:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966915:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966921:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966928:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966933:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141873.966938:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966945:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966964:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:3.0:1783141873.966967:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141873.966972:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966978:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899280 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966990:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.966996:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967001:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967005:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141873.967008:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967013:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967019:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff946489eed800) 00010000:00010000:3.0:1783141873.967021:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141873.967024:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967030:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da899287 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967053:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967059:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967064:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967068:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141873.967071:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967075:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967082:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648c722a00) 00010000:00010000:3.0:1783141873.967084:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141873.967086:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141873.967092:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89928e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141873.967180:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11486:x1869759492730240:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 576us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141873.967187:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 172 00000100:00100000:3.0:1783141873.970906:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141873.971030:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492730496 00000100:00100000:0.0:1783141873.971044:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492730496 00000100:00100000:0.0:1783141873.971125:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 173 00000100:00100000:0.0:1783141873.971137:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11486:x1869759492730496:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141873.971165:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141873.971191:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899295 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a004e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971363:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971381:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971402:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141873.971416:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783141873.971574:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971582:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971590:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971596:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141873.971601:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971609:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971624:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648c722a00) 00010000:00010000:0.0:1783141873.971628:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141873.971633:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971639:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da89929c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971690:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899295 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a004e expref: 42 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971714:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:0.0:1783141873.971716:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141873.971721:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899295 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a004e expref: 42 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141873.971731:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7400, rc 0) 00000100:00100000:0.0:1783141873.971806:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:11486:x1869759492730496:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 672us (917us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1783141873.971815:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 173 00000100:00100000:0.0:1783141873.976996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141873.977083:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492730624 00000100:00100000:3.0:1783141873.977096:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492730624 00000100:00100000:3.0:1783141873.977183:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 174 00000100:00100000:3.0:1783141873.977193:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:11486:x1869759492730624:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783141873.977250:0:10143:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783141873.977394:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:11486:x1869759492730624:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 201us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141873.977403:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 174 00000100:00100000:1.0:1783141873.990698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141873.994432:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492730880 00000100:00100000:2.0:1783141873.994454:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492730880 00000100:00100000:2.0:1783141873.994553:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 175 00000100:00100000:2.0:1783141873.994565:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:11486:x1869759492730880:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141873.994592:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141873.994596:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783141873.994631:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da899256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0040 expref: 41 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.994657:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141873.994664:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141873.994682:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8992aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0055 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783141873.995697:0:5787:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1783141873.996052:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8992b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.996070:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8992b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.996085:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8992b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.996173:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8992aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0055 expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.996192:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8992b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0055 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141873.996201:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94648c722700) 00010000:00010000:2.0:1783141873.996204:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141873.996207:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1c00, rc 0) 00000100:00100000:2.0:1783141873.996314:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:11486:x1869759492730880:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1749us (5864us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1783141873.996324:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 175 00000100:00100000:3.0:1783141874.003063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.003175:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492731136 00000100:00100000:0.0:1783141874.003188:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492731136 00000100:00100000:0.0:1783141874.003275:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 176 00000100:00100000:0.0:1783141874.003287:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:11486:x1869759492731136:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141874.003367:0:7171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141874.003402:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8992b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0055 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.003424:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94648c722700) 00010000:00010000:0.0:1783141874.003438:0:7171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141874.003489:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.003505:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.003529:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.003684:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.003693:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.003701:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.003985:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.003993:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004000:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004007:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141874.004012:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004021:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004031:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:0.0:1783141874.004034:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141874.004039:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004051:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8992bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004061:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004068:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004074:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004079:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141874.004082:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004089:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004097:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3a57a171 (ffff94648a1ada00) 00010000:00010000:0.0:1783141874.004100:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141874.004102:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.004108:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3a57a171 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141874.004265:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:11486:x1869759492731136:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 977us (1214us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141874.004273:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 176 00000100:00100000:0.0:1783141874.012357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.012504:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492731264 00000100:00100000:3.0:1783141874.012518:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492731264 00000100:00100000:3.0:1783141874.012601:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 177 00000100:00100000:3.0:1783141874.012613:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464876e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+41:11486:x1869759492731264:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141874.012640:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141874.012670:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a005c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.012717:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.012734:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.012747:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.012870:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a005c expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.012890:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a005c expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.012906:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:3.0:1783141874.012910:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783141874.012914:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16200, rc 0) 00000100:00100000:3.0:1783141874.012995:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464876e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:11486:x1869759492731264:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 384us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.013003:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 177 00000100:00100000:1.0:1783141874.016862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.017064:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492731520 00000100:00100000:0.0:1783141874.017077:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492731520 00000100:00100000:0.0:1783141874.017151:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 178 00000100:00100000:0.0:1783141874.017162:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:11486:x1869759492731520:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141874.017287:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.017310:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.017324:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783141874.018903:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1783141874.018923:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381223462010ns, next at 382223457596ns, rc = 0 00000004:00010000:0.0:1783141874.019049:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009635ce0e reply state 000000002423da74 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141874.019064:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141874.019222:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+44:11486:x1869759492731520:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 2057us (2368us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1783141874.019243:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 178 00000100:00100000:1.0:1783141874.026255:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.027113:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492731648 00000100:00100000:3.0:1783141874.027128:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492731648 00000100:00100000:3.0:1783141874.027207:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 179 00000100:00100000:3.0:1783141874.027218:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+44:11486:x1869759492731648:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141874.027260:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141874.027286:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0063 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.027365:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0063 expref: 45 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.027383:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0063 expref: 45 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.027407:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:3.0:1783141874.027411:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141874.027415:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17e00, rc 0) 00000100:00100000:3.0:1783141874.027522:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+45:11486:x1869759492731648:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 306us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.027542:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 179 00010000:00010000:2.0:1783141874.031206:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.031224:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.031246:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.031253:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141874.031259:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.031268:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.031290:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:2.0:1783141874.031300:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783141874.031307:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.031313:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da8992db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.036239:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.036322:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492731776 00000100:00100000:0.0:1783141874.036335:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492731776 00000100:00100000:0.0:1783141874.036423:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:0.0:1783141874.036437:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492731776:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783141874.036898:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492731776:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 463us (679us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1783141874.036918:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00080000:2.0:1783141874.037154:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141874.050605:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141874.050812:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492732032 00000100:00100000:1.0:1783141874.050827:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492732032 00000100:00100000:1.0:1783141874.050905:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:1.0:1783141874.050920:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+44:11486:x1869759492732032:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783141874.051285:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+45:11486:x1869759492732032:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 367us (694us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1783141874.051295:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:0.0:1783141874.054964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141874.055840:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492732288 00000100:00100000:1.0:1783141874.055853:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492732288 00000100:00100000:1.0:1783141874.055964:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 180 00000100:00100000:1.0:1783141874.055979:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+45:11486:x1869759492732288:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783141874.056141:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+45:11486:x1869759492732288:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 164us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141874.056154:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 180 00000100:00100000:0.0:1783141874.067640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141874.067969:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492732416 00000100:00100000:2.0:1783141874.067983:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492732416 00000100:00100000:2.0:1783141874.068070:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 181 00000100:00100000:2.0:1783141874.068083:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+45:11486:x1869759492732416:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141874.068112:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141874.068140:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8992e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a006a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.068243:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8992f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.068260:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8992f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.068274:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8992f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141874.068325:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141874.068347:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8992f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.068375:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8992e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a006a expref: 47 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.068419:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8992f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a006a expref: 46 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.068429:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:2.0:1783141874.068432:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783141874.068437:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0e00, rc 0) 00000100:00100000:2.0:1783141874.068528:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+46:11486:x1869759492732416:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 448us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141874.068536:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 181 00000100:00100000:3.0:1783141874.077691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.077775:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492732544 00000100:00100000:0.0:1783141874.077788:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492732544 00000100:00100000:0.0:1783141874.077889:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:0.0:1783141874.077904:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2367:x1869759492732544:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141874.077930:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141874.077958:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0071 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141874.077995:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4895f1, blocks: 0x1 00010000:00010000:0.0:1783141874.078022:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1783141874.078028:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141874.078040:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0071 expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.078064:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0071 expref: 8 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.078081:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6800, rc 0) 00000100:00100000:0.0:1783141874.078161:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2367:x1869759492732544:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 260us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141874.078169:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:1.0:1783141874.082594:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141874.082655:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492732800 00000100:00100000:1.0:1783141874.082668:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492732800 00000100:00100000:1.0:1783141874.082741:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 182 00000100:00100000:1.0:1783141874.082754:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+46:11486:x1869759492732800:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783141874.082894:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+46:11486:x1869759492732800:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 142us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141874.082904:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 182 00000100:00100000:0.0:1783141874.086454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.087142:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492732928 00000100:00100000:0.0:1783141874.087155:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492732928 00000100:00100000:0.0:1783141874.087215:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:0.0:1783141874.087226:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:11486:x1869759492732928:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141874.087262:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141874.088014:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0078 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.088068:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0071 expref: 9 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.088080:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141874.088084:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141874.088090:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.088131:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0071 expref: 9 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.088146:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0071 expref: 9 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141874.088163:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94638321bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510552192:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141874.089396:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141874.093310:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94638321bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510552192:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141874.093358:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.093395:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7600, rc 0) 00000100:00100000:0.0:1783141874.093497:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:11486:x1869759492732928:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 6270us (7054us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141874.093506:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:1.0:1783141874.098368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.098644:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492733056 00000100:00100000:3.0:1783141874.098658:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492733056 00010000:00010000:3.0:1783141874.098781:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0071 expref: 9 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.098835:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:3.0:1783141874.098847:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2368:x1869759492733056:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141874.098867:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141874.098897:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0071 expref: 9 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.098913:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0071 expref: 9 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.098943:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da8992f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0071 expref: 9 pid: 6586 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.098962:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141874.098968:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141874.098978:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.099012:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.099067:0:6600:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.099085:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6600:1869759510552320:192.168.203.27@tcp:105: 00000100:00100000:3.0:1783141874.099208:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464877dc180 going to sleep for 11 seconds 00000100:00100000:3.0:1783141874.104908:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6600:1869759510552320:192.168.203.27@tcp:105: 00010000:00010000:3.0:1783141874.105066:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141874.105150:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492733056:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 6304us (6796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.105165:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:1.0:1783141874.113223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.113330:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492733184 00000100:00100000:3.0:1783141874.113343:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492733184 00002000:00100000:3.0:1783141874.113409:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9463831b5500 x1869759492733184/t0(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:250/0 lens 504/0 e 0 to 0 dl 1783141885 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141874.113422:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9463831b5500 with x1869759492733184 ext(0->8) 00002000:00010000:3.0:1783141874.113430:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9463831b5500 00000100:00100000:3.0:1783141874.113497:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:3.0:1783141874.113507:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2369:x1869759492733184:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783141874.114726:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:2369:x1869759492733184:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 Request processed in 1211us (1509us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783141874.114746:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00002000:00100000:2.0:1783141874.114758:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9463831b5500 x1869759492733184/t4294967314(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:250/0 lens 504/448 e 0 to 0 dl 1783141885 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783141874.114769:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9463831b5500 with x1869759492733184 ext(0->8) 00002000:00010000:2.0:1783141874.114777:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9463831b5500 00000100:00100000:1.0:1783141874.117900:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141874.118120:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492733312 00000100:00100000:2.0:1783141874.118133:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492733312 00000100:00100000:2.0:1783141874.118555:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 183 00000100:00100000:2.0:1783141874.118568:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+46:11486:x1869759492733312:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783141874.177677:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1783141874.177693:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1783141874.177728:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1783141874.177768:0:5809:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1783141874.177909:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:11486:x1869759492733312:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 59334us (60013us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141874.177924:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 183 00000020:00080000:1.0:1783141874.177928:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1783141874.177942:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783141874.177960:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9463831b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510552448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783141874.178024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141874.178393:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510552448 00000100:00100000:2.0:1783141874.178420:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510552448 00000100:00080000:1.0:1783141874.180488:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141874.180810:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783141874.180828:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510552448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783141874.181073:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783141874.181077:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783141873 00002000:00010000:2.0:1783141874.181080:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783141874.181083:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783141873 -> 1783141873 00002000:00010000:2.0:1783141874.181086:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783141874.181185:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1869759510552448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 362us (3159us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783141874.181193:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1783141874.182707:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9463831b4700/2, rc 0, transno 4294967315 00000100:00100000:1.0:1783141874.182725:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9463831b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510552448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783141874.182891:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.184182:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492733440 00000100:00100000:3.0:1783141874.184199:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492733440 00000100:00100000:3.0:1783141874.184314:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:3.0:1783141874.184336:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:2369:x1869759492733440:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783141874.269822:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1783141874.269872:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1783141874.269880:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1783141874.270199:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492733440:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 85863us (87300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.270212:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:1.0:1783141874.273844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.275242:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492733696 00000100:00100000:3.0:1783141874.275262:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492733696 00000100:00100000:3.0:1783141874.275473:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 184 00000100:00100000:3.0:1783141874.275486:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:11486:x1869759492733696:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783141874.275537:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141874.275561:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da8992f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a006a expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.275580:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:3.0:1783141874.275586:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141874.275613:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.275626:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.275634:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141874.275877:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000191f28e9 reply state 000000001abd2dcc transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.275886:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141874.275998:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:11486:x1869759492733696:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 514us (2169us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1783141874.276005:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 184 00000100:00100000:3.0:1783141874.290121:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.290314:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492733824 00000100:00100000:3.0:1783141874.290323:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492733824 00000100:00100000:3.0:1783141874.290371:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:3.0:1783141874.290381:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2366:x1869759492733824:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783141874.290751:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1783141874.290756:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783141873 -> 1783141872 00002000:00010000:3.0:1783141874.290759:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783141871 00002000:00010000:3.0:1783141874.290761:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783141873 -> 1783141872 00002000:00010000:3.0:1783141874.290764:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783141874.290821:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2366:x1869759492733824:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 440us (709us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783141874.290965:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00010000:00010000:0.0:1783141874.291305:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.291316:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.291323:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.291330:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141874.291334:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.291342:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.291358:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:0.0:1783141874.291361:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141874.291366:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.291373:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899305 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.302857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.303030:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492734080 00000100:00100000:0.0:1783141874.303051:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492734080 00000100:00100000:0.0:1783141874.303153:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 185 00000100:00100000:0.0:1783141874.303166:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:11486:x1869759492734080:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783141874.303276:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.303300:0:10143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a005c expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.303311:0:10143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.303370:0:10143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a005c expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.303386:0:10143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a005c expref: 18 pid: 5786 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141874.303406:0:10143:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94638321bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510552576:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141874.303566:0:10143:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489ddb000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141874.308972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.309017:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492734208 00000100:00100000:3.0:1783141874.309029:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492734208 00010000:00010000:3.0:1783141874.309079:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a005c expref: 19 pid: 5786 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.309123:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:3.0:1783141874.309134:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:2368:x1869759492734208:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141874.309151:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141874.309159:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a005c expref: 19 pid: 5786 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.309182:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a005c expref: 19 pid: 5786 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.309210:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:2.0:1783141874.309215:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da8992d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a005c expref: 19 pid: 5786 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.309218:0:7493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.309249:0:7493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141874.309256:0:10143:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94638321bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10143:1869759510552576:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141874.309261:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.309286:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141874.309287:0:10143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.309300:0:10143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.309308:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.309348:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+18:2368:x1869759492734208:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 215us (390us total) trans 0 rc 0/0 00010000:00010000:2.0:1783141874.309353:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.309360:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 69 00010000:00010000:2.0:1783141874.309380:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.309388:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.309395:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141874.309400:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.309409:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.309421:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:2.0:1783141874.309425:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783141874.309429:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.309436:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7800/0x279ffa91da89930c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141874.309530:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:11486:x1869759492734080:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 Request processed in 6366us (6688us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783141874.309541:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 185 00000100:00100000:3.0:1783141874.315785:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.316689:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492734336 00000100:00100000:0.0:1783141874.316706:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492734336 00000100:00100000:0.0:1783141874.316778:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:0.0:1783141874.316791:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2369:x1869759492734336:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783141874.316849:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.316874:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.316892:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141874.316897:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141874.316903:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.316945:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.316962:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 8 pid: 6587 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141874.316980:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff94638321a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510552704:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141874.317090:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489ddbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141874.323004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.323045:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492734464 00000100:00100000:3.0:1783141874.323055:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492734464 00010000:00010000:3.0:1783141874.323108:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 9 pid: 6587 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.323784:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff94638321a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1869759510552704:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141874.323822:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.324237:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:3.0:1783141874.324253:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2368:x1869759492734464:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141874.324277:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141874.324315:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 9 pid: 6587 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324332:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 9 pid: 6587 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324361:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da8992fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0078 expref: 9 pid: 6587 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324379:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141874.324384:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141874.324391:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324403:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324437:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141874.324526:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492734464:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 276us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.324535:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 70 00010000:00010000:3.0:1783141874.324568:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324578:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324619:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324628:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324638:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324646:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141874.324651:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324660:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324673:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.324680:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000918e81a4/0x279ffa91da899313 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.324730:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492734336:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 7941us (8960us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.324739:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:3.0:1783141874.330017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141874.330385:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492734720 00000100:00100000:1.0:1783141874.330405:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492734720 00000100:00100000:1.0:1783141874.330551:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 186 00000100:00100000:1.0:1783141874.330563:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:11486:x1869759492734720:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783141874.330746:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.330771:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.330785:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.331070:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.331084:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0063 expref: 18 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.331094:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.331141:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0063 expref: 18 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.331157:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0063 expref: 18 pid: 7171 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.331175:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9463831b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510552832:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141874.332318:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649683ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141874.337912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141874.338350:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492734848 00000100:00100000:2.0:1783141874.338363:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492734848 00010000:00010000:2.0:1783141874.338418:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0063 expref: 19 pid: 7171 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141874.338491:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:2.0:1783141874.338514:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:2368:x1869759492734848:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141874.338533:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141874.338543:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0063 expref: 19 pid: 7171 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.338559:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0063 expref: 19 pid: 7171 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.338721:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:2.0:1783141874.338728:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.338740:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.338748:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.338772:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141874.338846:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:2368:x1869759492734848:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 335us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141874.338854:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 71 00010000:00010000:1.0:1783141874.338975:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8992e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0063 expref: 18 pid: 7171 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.339002:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9463831b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510552832:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141874.339026:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.339036:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.339043:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141874.339291:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1783141874.344949:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1783141874.345050:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1783141874.345172:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9463831b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1869759510552960:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783141874.345278:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141874.345336:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649683f900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141874.345370:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510552960 00000100:00100000:3.0:1783141874.345380:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510552960 00000100:00100000:3.0:1783141874.345485:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783141874.345497:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1869759510552960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783141874.345601:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1869759510552960:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.345609:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783141874.345656:0:5787:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1783141874.345664:0:5787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9463831b4700, transno 4294967315 00000100:00100000:3.0:1783141874.345681:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9463831b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1869759510552960:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1783141874.347054:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1783141874.347175:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971db100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1869759510553088:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783141874.347256:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141874.347296:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464a1a5fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141874.350566:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510553088 00000100:00100000:1.0:1783141874.350598:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510553088 00000100:00100000:1.0:1783141874.350682:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783141874.350694:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1869759510553088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783141874.351070:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1869759510553088:12345-0@lo:1000:mdt00_001.0 Request processed in 376us (3812us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1783141874.351080:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783141874.351278:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971db100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1869759510553088:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783141874.351336:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351348:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351356:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351363:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141874.351368:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351385:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351406:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff946489eed800) 00010000:00010000:3.0:1783141874.351418:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141874.351425:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351433:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da899321 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351492:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351499:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351506:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351512:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141874.351515:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351522:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351533:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648c722a00) 00010000:00010000:3.0:1783141874.351535:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141874.351539:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351556:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89925d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351582:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351600:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0047 expref: 21 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351609:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351651:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0047 expref: 21 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.351668:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0047 expref: 21 pid: 5788 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.351685:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510553216:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141874.351923:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648503d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783141874.357792:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.357886:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492734976 00000100:00100000:0.0:1783141874.357897:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492734976 00000100:00100000:1.0:1783141874.357906:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510553216:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141874.357945:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.357952:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0047 expref: 22 pid: 5788 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141874.358003:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:0.0:1783141874.358016:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:2368:x1869759492734976:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141874.358036:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141874.358044:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0047 expref: 22 pid: 5788 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.358058:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0047 expref: 22 pid: 5788 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.358095:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0047 expref: 22 pid: 5788 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.358112:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648c722a00) 00010000:00010000:0.0:1783141874.358118:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.358128:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.358136:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.358169:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141874.358244:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:2368:x1869759492734976:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 229us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141874.358253:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 72 00010000:00010000:1.0:1783141874.361640:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361662:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361681:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361688:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361696:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361704:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141874.361709:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361717:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361740:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648c722a00) 00010000:00010000:1.0:1783141874.361744:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141874.361750:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361756:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899328 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361781:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361812:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361818:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361822:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141874.361826:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361832:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361841:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648c722a00) 00010000:00010000:1.0:1783141874.361843:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783141874.361846:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.361852:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89931a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.362208:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11486:x1869759492734720:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 31641us (32199us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1783141874.362221:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 186 00000020:00080000:1.0:1783141874.362238:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783141874.362296:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141874.362303:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141874.367576:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783141874.367604:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141874.367608:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141874.370637:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492735232 00000100:00100000:2.0:1783141874.370658:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492735232 00000100:00100000:2.0:1783141874.370774:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:2.0:1783141874.370788:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11486:x1869759492735232:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783141874.371655:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783141874.371780:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1783141874.371844:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.371864:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.371879:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.371890:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.371897:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.371903:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.371933:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783141874.372072:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:11486:x1869759492735232:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 1283us (4481us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1783141874.372083:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 50 00000020:00080000:2.0:1783141874.372091:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783141874.372224:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141874.372243:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.372251:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141874.372256:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.372265:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.372281:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94648c722300) 00010000:00010000:0.0:1783141874.372292:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783141874.372300:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.372305:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89932f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.372327:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141874.372329:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141874.372330:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141874.394951:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783141874.417848:0:12322:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141874.417860:0:12322:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141874.417921:0:12322:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1783141874.417929:0:12322:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783141874.611720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141874.611837:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492735488 00000100:00100000:2.0:1783141874.611847:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492735488 00000100:00100000:2.0:1783141874.611905:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 187 00000100:00100000:2.0:1783141874.611915:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638321b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:11496:x1869759492735488:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141874.611944:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141874.611965:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a007f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.612257:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da89933d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.612272:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da89933d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.612284:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da89933d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141874.612296:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1783141874.612605:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a007f expref: 25 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.612624:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da89933d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a007f expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.612756:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141874.612760:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783141874.612763:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0e00, rc 0) 00000100:00100000:2.0:1783141874.612826:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638321b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11496:x1869759492735488:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 911us (1114us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1783141874.612835:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 187 00000100:00100000:2.0:1783141874.633240:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141874.633291:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492735616 00000100:00100000:2.0:1783141874.633300:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492735616 00000100:00100000:2.0:1783141874.633350:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 188 00000100:00100000:2.0:1783141874.633360:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11496:x1869759492735616:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:2.0:1783141874.633449:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633486:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633498:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633513:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633520:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633526:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633823:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633832:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633839:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141874.633878:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633890:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633906:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633913:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633919:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141874.633924:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633931:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633943:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141874.633946:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141874.633950:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633956:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89934b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633968:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633973:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633979:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633983:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141874.633991:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.633998:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.634005:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648c722e00) 00010000:00010000:2.0:1783141874.634008:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141874.634011:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.634016:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.634030:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.634037:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.634043:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.634048:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141874.634050:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.634055:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.634061:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648c722200) 00010000:00010000:2.0:1783141874.634063:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141874.634071:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.634077:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141874.634158:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11496:x1869759492735616:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 797us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141874.634167:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 188 00000100:00100000:2.0:1783141874.683331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141874.683655:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492735872 00000100:00100000:1.0:1783141874.683665:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492735872 00000100:00100000:1.0:1783141874.683723:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 189 00000100:00100000:1.0:1783141874.683733:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11499:x1869759492735872:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1783141874.683767:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141874.683798:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899360 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0086 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.683874:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.683889:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.683900:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.683914:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.683922:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.683929:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684378:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684399:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684407:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141874.684417:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783141874.684638:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684646:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684652:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684658:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141874.684662:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684670:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684682:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:1.0:1783141874.684685:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141874.684689:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684694:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899367 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684706:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684712:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684717:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684721:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141874.684730:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684736:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684743:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648becad00) 00010000:00010000:1.0:1783141874.684746:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141874.684748:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684754:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da89936e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684794:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899360 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0086 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684807:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0086 expref: 26 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.684814:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:1.0:1783141874.684816:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141874.684818:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52a00, rc 0) 00000100:00100000:1.0:1783141874.684991:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:11499:x1869759492735872:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1258us (1667us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1783141874.684999:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 189 00000100:00100000:2.0:1783141874.695871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.695989:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492736000 00000100:00100000:0.0:1783141874.696013:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492736000 00000100:00100000:0.0:1783141874.696088:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 190 00000100:00100000:0.0:1783141874.696101:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:11499:x1869759492736000:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:0.0:1783141874.696215:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.696248:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.696262:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.696297:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.696305:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.696313:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.696344:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141874.696349:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.696358:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.696372:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:0.0:1783141874.696376:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141874.696382:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141874.696389:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141874.698969:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:11499:x1869759492736000:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 2851us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141874.698988:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 190 00000100:00100000:2.0:1783141874.702266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.702359:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492736256 00000100:00100000:3.0:1783141874.702373:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492736256 00000100:00100000:3.0:1783141874.702439:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:3.0:1783141874.702451:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:11499:x1869759492736256:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1783141874.702792:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:11499:x1869759492736256:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 342us (538us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783141874.702805:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:2.0:1783141874.743262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.743434:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492736512 00000100:00100000:3.0:1783141874.743447:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492736512 00000100:00100000:2.0:1783141874.743860:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 191 00000100:00100000:2.0:1783141874.743874:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:11033:x1869759492736512:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:2.0:1783141874.743906:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141874.743931:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89938a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a008d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.744062:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.744078:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0086 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.744087:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.744145:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0086 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.744183:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0086 expref: 28 pid: 5787 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141874.744199:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497265c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510553344:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141874.744416:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899000 going to sleep for 11 seconds 00000100:00100000:0.0:1783141874.747704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141874.747864:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492736640 00000100:00100000:1.0:1783141874.747876:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492736640 00010000:00010000:1.0:1783141874.747931:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0086 expref: 29 pid: 5787 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.748002:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:1.0:1783141874.748013:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:2369:x1869759492736640:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141874.748032:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141874.748040:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0086 expref: 29 pid: 5787 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.748054:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0086 expref: 29 pid: 5787 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.748081:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:1.0:1783141874.748087:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.748097:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.748105:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.748136:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141874.748207:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:2369:x1869759492736640:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 195us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141874.748216:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 73 00010000:00010000:2.0:1783141874.748551:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da899375 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0086 expref: 28 pid: 5787 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141874.748573:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497265c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1869759510553344:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141874.748689:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.748701:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.748707:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141874.748730:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783141874.749178:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89938a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a008d expref: 29 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.749195:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a008d expref: 28 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.749204:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:2.0:1783141874.749219:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783141874.749222:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0800, rc 0) 00000100:00100000:2.0:1783141874.749274:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:11033:x1869759492736512:12345-192.168.203.27@tcp:101:bash.0 Request processed in 5404us (6028us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783141874.749282:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 191 00000100:00100000:0.0:1783141874.755855:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141874.756248:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492736896 00000100:00100000:1.0:1783141874.756263:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492736896 00000100:00100000:1.0:1783141874.756347:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 192 00000100:00100000:1.0:1783141874.756359:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:11033:x1869759492736896:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:1.0:1783141874.756773:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.756795:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.756809:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783141874.756877:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1783141874.756906:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009173d619 reply state 00000000f16b2c8c transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.756915:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783141874.756967:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1783141874.757100:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11033:x1869759492736896:12345-192.168.203.27@tcp:36:bash.0 Request processed in 741us (1257us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1783141874.757108:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 192 00000020:00080000:1.0:1783141874.757114:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1783141874.761850:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.761873:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.761881:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.761888:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141874.761894:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.761903:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.761924:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:2.0:1783141874.761927:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141874.761932:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.761938:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da89939f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141874.764197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.765760:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492737024 00000100:00100000:3.0:1783141874.765777:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492737024 00000100:00100000:3.0:1783141874.765897:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 193 00000100:00100000:3.0:1783141874.765910:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+31:11033:x1869759492737024:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141874.765941:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141874.765967:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da8993a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0094 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.766051:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da8993a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0094 expref: 32 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.766069:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da8993a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0094 expref: 32 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.766090:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:3.0:1783141874.766094:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141874.766113:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17400, rc 0) 00000100:00100000:3.0:1783141874.766200:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11033:x1869759492737024:12345-192.168.203.27@tcp:101:bash.0 Request processed in 293us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.766208:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 193 00000100:00100000:0.0:1783141874.775758:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.775882:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492737152 00000100:00100000:3.0:1783141874.775894:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492737152 00000100:00100000:3.0:1783141874.776005:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:3.0:1783141874.776016:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638321a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:11033:x1869759492737152:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141874.776041:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141874.776068:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a009b expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141874.776099:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4895f0, atime: 0x6a4895ef, ctime: 0x6a4895f0, blocks: 0xb 00010000:00010000:3.0:1783141874.776138:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1783141874.776144:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141874.776154:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a009b expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.776173:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a009b expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.776199:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16400, rc 0) 00000100:00100000:3.0:1783141874.776292:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638321a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:11033:x1869759492737152:12345-192.168.203.27@tcp:101:bash.0 Request processed in 276us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.776307:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:0.0:1783141874.780092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.780724:0:11838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492737280 00000100:00100000:3.0:1783141874.780757:0:11838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492737280 00002000:00010000:3.0:1783141874.780812:0:11838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1783141874.780818:0:11838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946383218700 with x1869759492737280 ext(0->18446744073709551615) 00002000:00010000:3.0:1783141874.780832:0:11838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946383218700. 00000100:00100000:3.0:1783141874.780876:0:11838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:3.0:1783141874.780887:0:11838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492737280:12345-192.168.203.27@tcp:10:bash.0 00002000:00010000:3.0:1783141874.781732:0:11838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783141874.781739:0:11838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783141872 -> 1783141874 00002000:00010000:3.0:1783141874.781742:0:11838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1783141871 -> 1783141871 00002000:00010000:3.0:1783141874.781744:0:11838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783141872 -> 1783141874 00002000:00010000:3.0:1783141874.781746:0:11838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1783141874.781832:0:11838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2368:x1869759492737280:12345-192.168.203.27@tcp:10:bash.0 Request processed in 943us (1752us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783141874.781843:0:11838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00002000:00010000:3.0:1783141874.781848:0:11838:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1783141874.781851:0:11838:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946383218700 with x1869759492737280 ext(0->18446744073709551615) 00002000:00010000:3.0:1783141874.781857:0:11838:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946383218700. 00000100:00100000:2.0:1783141874.847148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141874.847828:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492737408 00000100:00100000:0.0:1783141874.847844:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492737408 00000100:00100000:1.0:1783141874.848050:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:1.0:1783141874.848063:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11513:x1869759492737408:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:1.0:1783141874.848172:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.848194:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.848209:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.848236:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.848263:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.848271:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.848694:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.848705:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.848713:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141874.848763:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849189:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849199:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849207:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849214:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141874.849219:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849239:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849265:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:1.0:1783141874.849269:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141874.849276:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849283:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8993b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849301:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849308:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849315:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849320:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141874.849323:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849331:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849339:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648becad00) 00010000:00010000:1.0:1783141874.849342:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141874.849345:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849351:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849379:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849386:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849392:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849397:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141874.849400:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849407:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849415:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:1.0:1783141874.849418:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141874.849420:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.849426:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.849572:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11513:x1869759492737408:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 1507us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141874.849583:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:1.0:1783141874.888650:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141874.888769:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492737664 00000100:00100000:2.0:1783141874.888806:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492737664 00000100:00100000:2.0:1783141874.888880:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 195 00000100:00100000:2.0:1783141874.888894:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11516:x1869759492737664:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141874.888922:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141874.888949:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8993c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00a2 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889057:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889074:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889087:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889103:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889111:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889118:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889580:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8993de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889591:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8993de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889599:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8993de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141874.889619:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783141874.889740:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889748:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889756:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889763:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141874.889768:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889777:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889791:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141874.889796:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141874.889801:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889807:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8993d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889822:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889828:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889845:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889851:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141874.889855:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889862:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889871:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648c722200) 00010000:00010000:2.0:1783141874.889874:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141874.889878:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889884:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8993d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889935:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da8993c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00a2 expref: 35 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889951:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8993de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00a2 expref: 34 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141874.889959:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:2.0:1783141874.889961:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783141874.889964:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1e00, rc 0) 00000100:00100000:2.0:1783141874.890037:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:11516:x1869759492737664:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1146us (1402us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1783141874.890056:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 195 00000100:00100000:0.0:1783141874.898320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.898551:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492737792 00000100:00100000:3.0:1783141874.898563:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492737792 00000100:00100000:3.0:1783141874.898768:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:3.0:1783141874.898790:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638321aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:11516:x1869759492737792:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:3.0:1783141874.898881:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.898902:0:7171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a008d expref: 34 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.898931:0:7171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.898975:0:7171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a008d expref: 34 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.899005:0:7171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a008d expref: 34 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.899023:0:7171:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7171:1869759510553472:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141874.899143:0:7171:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648503d900 going to sleep for 11 seconds 00000100:00100000:0.0:1783141874.904921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.905025:0:7171:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7171:1869759510553472:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141874.905061:0:7171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.906172:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492738048 00000100:00100000:1.0:1783141874.906189:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492738048 00000100:00100000:1.0:1783141874.906309:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:1.0:1783141874.906321:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:5577:x1869759492738048:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783141874.907184:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:5577:x1869759492738048:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 856us (2268us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1783141874.907196:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:2.0:1783141874.915423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141874.915630:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492738176 00000100:00100000:3.0:1783141874.915644:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492738176 00010000:00010000:3.0:1783141874.915705:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a008d expref: 36 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141874.915761:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:3.0:1783141874.915772:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:2368:x1869759492738176:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141874.915801:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141874.915810:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a008d expref: 36 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.915852:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a008d expref: 36 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.915880:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899391 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a008d expref: 36 pid: 5788 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.915901:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:3.0:1783141874.915907:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.915920:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.915928:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141874.915974:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141874.916299:0:7171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.916309:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.916349:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.916358:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.916366:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.916373:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141874.916378:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.916387:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.916398:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:1.0:1783141874.916402:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783141874.916406:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141874.916425:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8993ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141874.916576:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638321aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11516:x1869759492737792:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 17796us (18268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141874.916586:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 196 00000100:00100000:3.0:1783141874.917651:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:2368:x1869759492738176:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 1872us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141874.917663:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:2.0:1783141874.920217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141874.920311:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492738432 00000100:00100000:1.0:1783141874.920324:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492738432 00000100:00100000:1.0:1783141874.920391:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:1.0:1783141874.920414:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+34:11516:x1869759492738432:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1783141874.920817:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11516:x1869759492738432:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 413us (610us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1783141874.920849:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:0.0:1783141875.002195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141875.002436:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492738688 00000100:00100000:1.0:1783141875.002450:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492738688 00000100:00100000:1.0:1783141875.002614:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 197 00000100:00100000:1.0:1783141875.002627:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638321b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+35:11527:x1869759492738688:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:1.0:1783141875.002656:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141875.002683:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00a9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.002777:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.002794:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.002807:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.002824:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.002850:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.002857:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783141875.003588:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783141875.004883:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da899408 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.004909:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da899408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.004923:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da899408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141875.004944:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1783141875.005101:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005110:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005118:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005194:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141875.005201:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005211:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005253:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:1.0:1783141875.005256:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141875.005263:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005270:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8993fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005291:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005374:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005381:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005387:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141875.005390:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005397:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005406:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648becad00) 00010000:00010000:1.0:1783141875.005409:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141875.005412:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005418:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005689:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8993f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00a9 expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005707:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da899408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00a9 expref: 37 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.005715:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:1.0:1783141875.005717:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141875.005720:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53400, rc 0) 00000100:00100000:1.0:1783141875.005823:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638321b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+37:11527:x1869759492738688:12345-192.168.203.27@tcp:101:cat.0 Request processed in 3197us (3643us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1783141875.005833:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 197 00000100:00100000:2.0:1783141875.010011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141875.010126:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492738944 00000100:00100000:0.0:1783141875.010139:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492738944 00000100:00100000:0.0:1783141875.010258:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:0.0:1783141875.010271:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+37:11527:x1869759492738944:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:0.0:1783141875.010657:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:11527:x1869759492738944:12345-192.168.203.27@tcp:35:cat.0 Request processed in 387us (658us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1783141875.010666:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:2.0:1783141875.026048:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.026174:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492739200 00000100:00100000:3.0:1783141875.026186:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492739200 00000100:00100000:3.0:1783141875.026323:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 198 00000100:00100000:3.0:1783141875.026335:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:11528:x1869759492739200:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:3.0:1783141875.026416:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783141875.026452:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da899408 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00a9 expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.026577:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8993de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00a2 expref: 37 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.026591:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da8993a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0094 expref: 36 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.026602:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94648becae00) 00010000:00010000:3.0:1783141875.026615:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141875.026641:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.026657:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.026669:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.026683:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.026690:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.026697:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.027078:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.027088:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.027101:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783141875.027826:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1783141875.027840:0:5786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382232379101ns, next at 383232376260ns, rc = 0 00010000:00010000:3.0:1783141875.027914:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.027927:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.027937:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.027945:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.027952:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.027960:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.027993:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783141875.028024:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028031:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028038:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028050:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141875.028056:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028064:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028077:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946489eed400) 00010000:00010000:3.0:1783141875.028080:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783141875.028084:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028090:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899424 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028110:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028115:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028121:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028131:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141875.028134:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028140:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028160:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:3.0:1783141875.028162:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141875.028165:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.028172:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16a00/0x279ffa91da899416 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783141875.028184:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af812077 reply state 000000003451487f transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141875.028194:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783141875.028323:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+37:11528:x1869759492739200:12345-192.168.203.27@tcp:36:rm.0 Request processed in 1985us (2286us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1783141875.028334:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 198 00010000:00010000:2.0:1783141875.028875:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141875.028884:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.028892:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141875.028896:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.028903:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.028914:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff946489eed400) 00010000:00010000:2.0:1783141875.028916:0:7492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783141875.028920:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.028926:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da89942b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.028947:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141875.028949:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141875.028950:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141875.031682:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.031706:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.031715:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.031722:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141875.031728:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.031736:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.031758:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff946489eed900) 00010000:00010000:0.0:1783141875.031762:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141875.031768:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.031795:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da89941d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141875.075693:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141875.075808:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492739456 00000100:00100000:1.0:1783141875.075822:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492739456 00000100:00100000:1.0:1783141875.075895:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 199 00000100:00100000:1.0:1783141875.075906:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+36:11534:x1869759492739456:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1783141875.075940:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141875.075968:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899432 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00b0 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.076281:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.076300:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.076313:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.076348:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.076356:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.076363:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783141875.077109:0:7171:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1783141875.078277:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078322:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078337:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078389:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078398:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078407:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078414:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141875.078420:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078428:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078444:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141875.078447:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141875.078453:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078493:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da899439 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141875.078512:0:7171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d550328 reply state 00000000ce5982c9 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141875.078542:0:7171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783141875.078587:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899432 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b0 expref: 39 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078603:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b0 expref: 38 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.078611:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94648c722200) 00010000:00010000:2.0:1783141875.078613:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141875.078616:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1c00, rc 0) 00000100:00100000:2.0:1783141875.078718:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:11534:x1869759492739456:12345-192.168.203.27@tcp:101:bash.0 Request processed in 2813us (3039us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1783141875.078728:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 199 00010000:00010000:1.0:1783141875.082234:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.082257:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.082266:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.082273:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141875.082279:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.082288:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.082321:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648becad00) 00010000:00010000:1.0:1783141875.082324:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141875.082330:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.082367:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da899440 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141875.083572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.083880:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492739584 00000100:00100000:3.0:1783141875.083894:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492739584 00000100:00100000:3.0:1783141875.083982:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:3.0:1783141875.083995:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2368:x1869759492739584:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141875.084019:0:10144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141875.084045:0:10144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00b7 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141875.084078:0:10144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783141875.084104:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1783141875.084110:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141875.084121:0:10144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b7 expref: 6 pid: 10144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.084181:0:10144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b7 expref: 6 pid: 10144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.084196:0:10144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16a00, rc 0) 00000100:00100000:3.0:1783141875.084287:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2368:x1869759492739584:12345-192.168.203.27@tcp:101:bash.0 Request processed in 293us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.084296:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00080000:2.0:1783141875.086034:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141875.086787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141875.086924:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492739712 00000100:00100000:0.0:1783141875.086976:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492739712 00000100:00100000:0.0:1783141875.087040:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:0.0:1783141875.087052:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:11534:x1869759492739712:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1783141875.087075:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141875.087099:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00be expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.087280:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b7 expref: 7 pid: 10144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.087292:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141875.087297:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141875.087304:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.087351:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b7 expref: 7 pid: 10144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.087366:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b7 expref: 7 pid: 10144 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141875.087384:0:6586:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946383218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1869759510553600:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141875.087547:0:6586:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489ddb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141875.089841:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141875.090000:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492739840 00000100:00100000:1.0:1783141875.090011:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492739840 00010000:00010000:1.0:1783141875.090062:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b7 expref: 8 pid: 10144 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141875.090112:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:1.0:1783141875.090123:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492739840:12345-192.168.203.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783141875.090134:0:6586:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946383218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1869759510553600:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141875.090142:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141875.090169:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b7 expref: 8 pid: 10144 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.090173:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.090184:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b7 expref: 8 pid: 10144 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.090212:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a67423/0x279ffa91da899455 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b7 expref: 8 pid: 10144 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.090601:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141875.090608:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141875.090619:0:6586:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.090632:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.090679:0:6586:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141875.090696:0:6586:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946383218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1869759510553728:192.168.203.27@tcp:105: 00000100:00100000:0.0:1783141875.090790:0:6586:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489ddb9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1783141875.090877:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141875.090907:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2368:x1869759492739840:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 785us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.090915:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:0.0:1783141875.096205:0:6586:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946383218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1869759510553728:192.168.203.27@tcp:105: 00010000:00010000:0.0:1783141875.096248:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6800, rc 0) 00000100:00100000:0.0:1783141875.096372:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:11534:x1869759492739712:12345-192.168.203.27@tcp:101:bash.0 Request processed in 9319us (9589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141875.096383:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:2.0:1783141875.100401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.103727:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492740096 00000100:00100000:3.0:1783141875.103750:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492740096 00000100:00100000:2.0:1783141875.106973:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:2.0:1783141875.106994:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+38:11534:x1869759492740096:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:2.0:1783141875.107822:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:11534:x1869759492740096:12345-192.168.203.27@tcp:35:bash.0 Request processed in 827us (7430us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1783141875.107833:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:3.0:1783141875.264990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141875.265503:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492740224 00000100:00100000:1.0:1783141875.265532:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492740224 00000100:00100000:1.0:1783141875.265609:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:1.0:1783141875.265621:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+39:11550:x1869759492740224:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1783141875.265653:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141875.265678:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da899463 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00c5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.265773:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da89946a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.265790:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da89946a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.265803:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da89946a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141875.265880:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1783141875.265884:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141875.265908:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da89946a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.265946:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da899463 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00c5 expref: 41 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.265967:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da89946a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00c5 expref: 40 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.265977:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:1.0:1783141875.265980:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141875.265984:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52000, rc 0) 00000100:00100000:1.0:1783141875.266072:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11550:x1869759492740224:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 448us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.266081:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 200 00000100:00100000:1.0:1783141875.275060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.275233:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492740480 00000100:00100000:3.0:1783141875.275249:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492740480 00000100:00100000:3.0:1783141875.275339:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 201 00000100:00100000:3.0:1783141875.275352:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+40:11550:x1869759492740480:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141875.275379:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141875.275406:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899471 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00cc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.275721:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da899478 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.275738:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da899478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.275754:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da899478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141875.275785:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783141875.275952:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da899471 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00cc expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.275975:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da899478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00cc expref: 42 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.275985:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94648c722200) 00010000:00010000:3.0:1783141875.275988:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141875.275993:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17400, rc 0) 00000100:00100000:3.0:1783141875.276084:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:11550:x1869759492740480:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 734us (1038us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1783141875.276092:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 201 00000100:00100000:2.0:1783141875.283200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.283510:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492740736 00000100:00100000:3.0:1783141875.283523:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492740736 00000100:00100000:3.0:1783141875.283598:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:3.0:1783141875.283610:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+42:11550:x1869759492740736:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141875.283644:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141875.283671:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da899486 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00d3 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.283799:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da89948d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.283817:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da89948d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.283853:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da89948d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141875.283870:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783141875.284045:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da899486 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00d3 expref: 45 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.284081:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da89948d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00d3 expref: 44 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.284092:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94648c722200) 00010000:00010000:3.0:1783141875.284095:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783141875.284108:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16200, rc 0) 00000100:00100000:3.0:1783141875.284197:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+44:11550:x1869759492740736:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 588us (1010us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1783141875.284205:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:0.0:1783141875.291736:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141875.291827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.291965:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492740864 00000100:00100000:3.0:1783141875.291977:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492740864 00000100:00100000:3.0:1783141875.292059:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:3.0:1783141875.292071:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+44:2368:x1869759492740864:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141875.292102:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141875.292147:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da899478 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00cc expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.292171:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94648c722200) 00010000:00010000:3.0:1783141875.292177:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141875.292269:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+43:2368:x1869759492740864:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 199us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.292279:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:1.0:1783141875.294037:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492740992 00000100:00100000:1.0:1783141875.294054:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492740992 00000100:00100000:1.0:1783141875.294486:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:1.0:1783141875.294500:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+6:2369:x1869759492740992:12345-192.168.203.27@tcp:1:lfs.0 00010000:00010000:1.0:1783141875.294558:0:10144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.294583:0:10144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.294594:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141875.294599:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141875.294603:0:10144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.294649:0:10144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.294666:0:10144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 6 pid: 6586 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141875.294684:0:10144:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9463831b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10144:1869759510553856:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141875.294825:0:10144:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649683f480 going to sleep for 11 seconds 00000100:00100000:2.0:1783141875.299445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141875.299746:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492741120 00000100:00100000:0.0:1783141875.299760:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492741120 00002000:00100000:0.0:1783141875.299829:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff946497257480 x1869759492741120/t0(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:251/0 lens 504/0 e 0 to 0 dl 1783141886 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141875.299842:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946497257480 with x1869759492741120 ext(0->8) 00010000:00010000:0.0:1783141875.299852:0:6592:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 7 pid: 6586 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.299870:0:6592:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 7 pid: 6586 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141875.299879:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946497257480 00000100:00100000:0.0:1783141875.299917:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:0.0:1783141875.299928:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492741120:12345-192.168.203.27@tcp:4:lfs.0 00000100:00100000:0.0:1783141875.300661:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2369:x1869759492741120:12345-192.168.203.27@tcp:4:lfs.0 Request processed in 730us (1237us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783141875.300672:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00002000:00100000:0.0:1783141875.300680:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff946497257480 x1869759492741120/t4294967308(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:251/0 lens 504/448 e 0 to 0 dl 1783141886 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141875.300689:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946497257480 with x1869759492741120 ext(0->8) 00010000:00010000:0.0:1783141875.300697:0:6592:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 9 pid: 6586 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.300711:0:6592:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 9 pid: 6586 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783141875.300729:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946497257480 00000100:00100000:1.0:1783141875.302215:0:10144:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9463831b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10144:1869759510553856:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141875.302260:0:10144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141875.306785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.306947:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492741248 00000100:00100000:3.0:1783141875.306960:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492741248 00010000:00010000:3.0:1783141875.307010:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 9 pid: 6586 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141875.307053:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:3.0:1783141875.307063:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638321ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2368:x1869759492741248:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141875.307093:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783141875.307116:0:6600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783141875.307119:0:6600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783141874 00002000:00010000:3.0:1783141875.307122:0:6600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783141875 00002000:00010000:3.0:1783141875.307125:0:6600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783141874 00010000:00010000:3.0:1783141875.307131:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 9 pid: 6586 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.307147:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 9 pid: 6586 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.307176:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cae52f14/0x279ffa91da89945c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00be expref: 9 pid: 6586 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.307196:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141875.307201:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141875.307208:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.307249:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.307293:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141875.307521:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638321ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2368:x1869759492741248:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 456us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.307530:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 76 00010000:00010000:2.0:1783141875.307659:0:10144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.307678:0:10144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.307709:0:10144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.307718:0:10144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.307726:0:10144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.307734:0:10144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53e00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141875.307738:0:10144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.307748:0:10144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.307761:0:10144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.307769:0:10144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c388ce7/0x279ffa91da89949b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141875.307847:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492740992:12345-192.168.203.27@tcp:1:lfs.0 Request processed in 13349us (16019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141875.307857:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:3.0:1783141875.313600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141875.313748:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492741504 00000100:00100000:2.0:1783141875.313760:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492741504 00000100:00100000:2.0:1783141875.313843:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:2.0:1783141875.313854:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+43:11550:x1869759492741504:12345-192.168.203.27@tcp:35:lfs.0 00000004:00010000:2.0:1783141875.313943:0:5790:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da89948d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00d3 expref: 43 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141875.314289:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1783141875.314351:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1783141875.314788:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1783141875.314856:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.314876:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b0 expref: 47 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.314887:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.314935:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b0 expref: 47 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.314954:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b0 expref: 47 pid: 7171 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141875.314995:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497254380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1869759510553984:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141875.320723:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141875.325161:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497254380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1869759510553984:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141875.325203:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141875.326723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141875.327182:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492741632 00000100:00100000:1.0:1783141875.327195:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492741632 00010000:00010000:1.0:1783141875.327259:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b0 expref: 48 pid: 7171 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141875.327305:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:1.0:1783141875.327316:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+48:2368:x1869759492741632:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141875.327346:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141875.327353:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b0 expref: 48 pid: 7171 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.327366:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b0 expref: 48 pid: 7171 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.327394:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00b0 expref: 48 pid: 7171 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.327417:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94648c722200) 00010000:00010000:1.0:1783141875.327452:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.327518:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.327527:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.327567:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141875.327742:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.327751:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141875.327891:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+47:2368:x1869759492741632:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 574us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.327900:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 77 00000001:00080000:2.0:1783141875.327914:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1783141875.328177:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1783141875.328563:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497255500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510554112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783141875.328637:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141875.328676:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464868990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141875.330210:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510554112 00000100:00100000:1.0:1783141875.330239:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510554112 00000100:00100000:1.0:1783141875.330341:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783141875.330353:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1869759510554112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1783141875.330429:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141875.330764:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1869759510554112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 412us (2125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.330772:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141875.330867:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497255500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510554112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783141875.331841:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1783141875.331956:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497255500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510554240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783141875.332022:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141875.333979:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510554240 00000100:00100000:2.0:1783141875.333993:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899180 going to sleep for 11 seconds 00000100:00100000:1.0:1783141875.333996:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510554240 00000100:00100000:1.0:1783141875.334081:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783141875.334093:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1869759510554240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783141875.334419:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5790:x1869759510554240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 327us (2394us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783141875.334438:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783141875.334833:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497255500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1869759510554240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783141875.334931:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1783141875.334991:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.335003:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.335027:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.335033:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141875.335039:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.335048:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.335079:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94648c722200) 00010000:00010000:2.0:1783141875.335083:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783141875.335089:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.335096:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783141875.335635:0:5790:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783141875.335748:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1783141875.335761:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382540299908ns, next at 383540296649ns, rc = 0 00000001:00080000:2.0:1783141875.335768:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1783141875.335808:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94648c722200) 00010000:00010000:2.0:1783141875.335812:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783141875.335820:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16200/0x279ffa91da89948d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00d3 expref: 51 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141875.335937:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+50:11550:x1869759492741504:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 22084us (22357us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1783141875.335959:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00000020:00080000:2.0:1783141875.335965:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1783141875.349119:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.349192:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492741760 00000100:00100000:3.0:1783141875.349206:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492741760 00000100:00100000:3.0:1783141875.349302:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 203 00000100:00100000:3.0:1783141875.349312:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638321b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+50:11550:x1869759492741760:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141875.349343:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141875.349371:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da8994a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00da expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.349508:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da8994a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00da expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.349527:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da8994a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00da expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.349549:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141875.349552:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783141875.349556:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17400, rc 0) 00000100:00100000:3.0:1783141875.349625:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638321b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+51:11550:x1869759492741760:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 314us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.349651:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 203 00000100:00100000:0.0:1783141875.359263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141875.359517:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492742016 00000100:00100000:2.0:1783141875.359530:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492742016 00000100:00100000:2.0:1783141875.359640:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 57 00000100:00100000:2.0:1783141875.359653:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+51:11550:x1869759492742016:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1783141875.360036:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:11550:x1869759492742016:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 384us (786us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1783141875.360046:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 57 00010000:00010000:0.0:1783141875.419507:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783141875.419916:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141875.419924:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141875.420170:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1783141875.420179:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783141875.458394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141875.458712:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492742144 00000100:00100000:2.0:1783141875.458725:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492742144 00000100:00100000:2.0:1783141875.458800:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00100000:2.0:1783141875.458812:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:11560:x1869759492742144:12345-192.168.203.27@tcp:34:lfs.0 00010000:00010000:2.0:1783141875.458916:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.458938:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.458951:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.458969:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.458977:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.458983:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459141:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459150:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459156:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141875.459213:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459241:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459248:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459255:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459262:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141875.459267:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459276:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459360:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141875.459364:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141875.459370:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459383:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8994b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459400:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459407:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459412:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459418:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141875.459596:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459603:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459612:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648c722200) 00010000:00010000:2.0:1783141875.459615:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141875.459618:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459625:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8994b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459642:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459648:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459660:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459665:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141875.459668:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459674:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459682:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:2.0:1783141875.459685:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141875.459688:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.459694:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141875.459901:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:11560:x1869759492742144:12345-192.168.203.27@tcp:34:lfs.0 Request processed in 1088us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141875.459911:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 204 00000100:00100000:0.0:1783141875.517588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141875.517694:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492742400 00000100:00100000:1.0:1783141875.517704:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492742400 00000100:00100000:1.0:1783141875.517778:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 205 00000100:00100000:1.0:1783141875.517789:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946383218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+52:11563:x1869759492742400:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1783141875.517809:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141875.517831:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da8994c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00e1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.517900:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.517915:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.517935:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.517950:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.517956:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.517962:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518086:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8994da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518095:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8994da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518101:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8994da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141875.518361:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783141875.518500:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518508:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518514:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518520:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141875.518525:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518532:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518543:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:1.0:1783141875.518547:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141875.518551:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518558:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da8994cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518572:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518577:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518596:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518601:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141875.518604:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518610:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518618:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648becad00) 00010000:00010000:1.0:1783141875.518621:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141875.518624:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518629:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da8994d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518671:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53e00/0x279ffa91da8994c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00e1 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518685:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8994da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00e1 expref: 54 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.518693:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141875.518695:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141875.518697:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52e00, rc 0) 00000100:00100000:1.0:1783141875.518816:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946383218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:11563:x1869759492742400:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1029us (1237us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1783141875.518832:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 205 00000100:00100000:3.0:1783141875.528633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141875.528730:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492742528 00000100:00100000:2.0:1783141875.528739:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492742528 00000100:00100000:2.0:1783141875.528795:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:2.0:1783141875.528806:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:11563:x1869759492742528:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:2.0:1783141875.528876:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.528893:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.528918:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.528960:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.528966:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.528972:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.528978:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141875.528981:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.528987:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.528998:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:2.0:1783141875.529001:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141875.529005:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.529010:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da8994e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141875.529084:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:11563:x1869759492742528:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 280us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141875.529092:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 206 00000100:00100000:0.0:1783141875.532708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141875.532856:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492742784 00000100:00100000:2.0:1783141875.532877:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492742784 00000100:00100000:2.0:1783141875.532938:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:2.0:1783141875.532948:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638321a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+54:11563:x1869759492742784:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1783141875.533199:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638321a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:11563:x1869759492742784:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 243us (495us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1783141875.533207:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 58 00000100:00100000:2.0:1783141875.660390:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.660694:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492743040 00000100:00100000:3.0:1783141875.660707:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492743040 00000100:00100000:3.0:1783141875.660932:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 207 00000100:00100000:3.0:1783141875.660947:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+55:11573:x1869759492743040:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141875.660980:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141875.660984:0:10143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783141875.661021:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52000/0x279ffa91da89946a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00c5 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.661045:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:3.0:1783141875.661051:0:10143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141875.661067:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8994ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00e8 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.661378:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8994f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.661883:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8994f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.661903:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8994f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141875.661941:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783141875.662122:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da8994ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00e8 expref: 57 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.662824:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8994f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00e8 expref: 56 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.662836:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141875.662839:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141875.662842:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17000, rc 0) 00000100:00100000:3.0:1783141875.662926:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:11573:x1869759492743040:12345-192.168.203.27@tcp:101:bash.0 Request processed in 1982us (2550us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1783141875.662936:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 207 00000100:00100000:3.0:1783141875.674058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141875.674275:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492743296 00000100:00100000:1.0:1783141875.674288:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492743296 00000100:00100000:1.0:1783141875.674370:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 208 00000100:00100000:1.0:1783141875.674382:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:11573:x1869759492743296:12345-192.168.203.27@tcp:36:bash.0 00010000:00010000:0.0:1783141875.675033:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783141875.675128:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17000/0x279ffa91da8994f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00e8 expref: 56 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.675156:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52e00/0x279ffa91da8994da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00e1 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.675168:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141875.675174:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141875.675879:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.675898:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.675908:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141875.675967:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1783141875.675991:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e055c67b reply state 000000000d1b873b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141875.676017:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141875.677989:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:11573:x1869759492743296:12345-192.168.203.27@tcp:36:bash.0 Request processed in 3593us (3932us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1783141875.678003:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 208 00000020:00080000:0.0:1783141875.678011:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783141875.681026:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.681048:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.681057:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.681064:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141875.681070:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.681078:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.681131:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141875.681135:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141875.681140:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.681148:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7400/0x279ffa91da899504 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141875.690300:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.691608:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492743424 00000100:00100000:3.0:1783141875.691627:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492743424 00000100:00100000:3.0:1783141875.691704:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 209 00000100:00100000:3.0:1783141875.691716:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638321bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+56:11573:x1869759492743424:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141875.691748:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141875.691775:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89950b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00ef expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.691882:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.691899:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.691913:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141875.691952:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783141875.691957:0:7171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783141875.691981:0:7171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.692034:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da89950b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00ef expref: 58 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.692056:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00ef expref: 57 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.692066:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141875.692069:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141875.692073:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16600, rc 0) 00000100:00100000:3.0:1783141875.692161:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638321bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:11573:x1869759492743424:12345-192.168.203.27@tcp:101:bash.0 Request processed in 446us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.692168:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 209 00000100:00100000:2.0:1783141875.710612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141875.717020:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492743680 00000100:00100000:0.0:1783141875.717040:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492743680 00000100:00100000:1.0:1783141875.717257:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:1.0:1783141875.717270:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+57:11573:x1869759492743680:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:1.0:1783141875.717638:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+58:11573:x1869759492743680:12345-192.168.203.27@tcp:35:bash.0 Request processed in 369us (7039us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1783141875.717647:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:2.0:1783141875.798291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.798692:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492743808 00000100:00100000:3.0:1783141875.798705:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492743808 00000100:00100000:2.0:1783141875.798936:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00100000:2.0:1783141875.798948:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+58:11579:x1869759492743808:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141875.798981:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141875.799006:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00f6 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.799103:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.799121:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.799135:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141875.799211:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783141875.799225:0:10143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141875.799251:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.799300:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00f6 expref: 60 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.799322:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00f6 expref: 59 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.799332:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141875.799335:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141875.799339:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0800, rc 0) 00000100:00100000:2.0:1783141875.799430:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:11579:x1869759492743808:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 484us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141875.799437:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00100000:0.0:1783141875.805259:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141875.806639:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492743936 00000100:00100000:2.0:1783141875.806656:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492743936 00000100:00100000:2.0:1783141875.806735:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 211 00000100:00100000:2.0:1783141875.806748:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:11579:x1869759492743936:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141875.806774:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141875.806802:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da899527 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a00fd expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.806880:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.806911:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.806923:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.806960:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.806969:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.806976:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807103:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807113:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807120:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141875.807164:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783141875.807169:0:10143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141875.807190:0:10143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807204:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807214:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807234:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807253:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807260:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141875.807266:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807276:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807292:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:2.0:1783141875.807297:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141875.807304:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807311:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da89952e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807327:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807333:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807339:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807343:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141875.807346:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807363:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807372:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648c722200) 00010000:00010000:2.0:1783141875.807374:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141875.807377:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.807384:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da899535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.808024:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da899527 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 61 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.808043:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 60 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.808051:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:2.0:1783141875.808054:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141875.808056:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1e00, rc 0) 00000100:00100000:2.0:1783141875.808187:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11579:x1869759492743936:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1440us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141875.808196:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 211 00000100:00100000:0.0:1783141875.820450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.826028:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492744192 00000100:00100000:3.0:1783141875.826048:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492744192 00000100:00100000:3.0:1783141875.826185:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 212 00000100:00100000:3.0:1783141875.826197:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11579:x1869759492744192:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141875.826235:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141875.826262:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da899543 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0104 expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.826411:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.826437:0:7171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00ef expref: 61 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.826495:0:7171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 61 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.826505:0:7171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.826560:0:7171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 61 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.826795:0:7171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 61 pid: 10143 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141875.826813:0:7171:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971db800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7171:1869759510554368:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141875.827774:0:7171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00ef expref: 61 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.827791:0:7171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00ef expref: 61 pid: 7171 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141875.827804:0:7171:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9463831b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7171:1869759510554496:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141875.828095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141875.828790:0:7171:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648503d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783141875.829249:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492744320 00000100:00100000:0.0:1783141875.829261:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492744320 00010000:00010000:0.0:1783141875.829410:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 62 pid: 10143 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141875.829588:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:0.0:1783141875.829601:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+62:2369:x1869759492744320:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141875.829619:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141875.829627:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 62 pid: 10143 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.829642:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 62 pid: 10143 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.829667:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141875.829674:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.829704:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.829711:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141875.829771:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+62:2369:x1869759492744320:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 172us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141875.829779:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:2.0:1783141875.836142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00010000:00010000:1.0:1783141875.836299:0:7171:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.27@tcp) returned -22 from blocking AST (req@00000000521fa96b x1869759510554368) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 61 pid: 10143 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.836331:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da89953c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00fd expref: 61 pid: 10143 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141875.836378:0:7171:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971db800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7171:1869759510554368:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141875.836394:0:7171:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9463831b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7171:1869759510554496:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141875.836430:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141875.836436:0:7171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.836446:0:7171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.836457:0:7171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141875.836687:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492744448 00000100:00100000:3.0:1783141875.836696:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492744448 00010000:00010000:3.0:1783141875.836741:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00ef expref: 61 pid: 7171 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141875.836784:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:3.0:1783141875.836795:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:2369:x1869759492744448:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141875.836813:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141875.836818:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00ef expref: 61 pid: 7171 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.836831:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00ef expref: 61 pid: 7171 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.836864:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da899512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00ef expref: 61 pid: 7171 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.836876:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141875.836879:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.836899:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.836907:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.836937:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141875.837000:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:2369:x1869759492744448:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 206us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.837007:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 79 00010000:00010000:0.0:1783141875.838116:0:7171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.838132:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141875.838158:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783141875.839256:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17e00/0x279ffa91da899543 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0104 expref: 61 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.839285:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0104 expref: 60 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141875.839295:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141875.839299:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783141875.839302:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17c00, rc 0) 00000100:00100000:0.0:1783141875.839575:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11579:x1869759492744192:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 13378us (19136us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1783141875.839585:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 212 00000100:00100000:2.0:1783141875.845322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141875.845555:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492744704 00000100:00100000:3.0:1783141875.845568:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492744704 00000100:00100000:3.0:1783141875.845657:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:3.0:1783141875.845669:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11579:x1869759492744704:12345-192.168.203.27@tcp:103:lfs.0 00010000:00010000:3.0:1783141875.845693:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141875.845723:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17400/0x279ffa91da8994a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00da expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141875.845744:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:3.0:1783141875.845750:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141875.845832:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:11579:x1869759492744704:12345-192.168.203.27@tcp:103:lfs.0 Request processed in 165us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141875.845846:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:2.0:1783141875.848379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141875.848780:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492744832 00000100:00100000:1.0:1783141875.848794:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492744832 00000100:00100000:1.0:1783141875.848897:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 213 00000100:00100000:1.0:1783141875.848908:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:11579:x1869759492744832:12345-192.168.203.27@tcp:58:lfs.0 00010000:00010000:1.0:1783141875.849060:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.849080:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141875.849094:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783141875.849353:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1783141875.849512:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:11579:x1869759492744832:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 604us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141875.849528:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 213 00000100:00100000:1.0:1783141875.853313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141875.854265:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492744960 00000100:00100000:2.0:1783141875.854350:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492744960 00000100:00100000:2.0:1783141875.854487:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 214 00000100:00100000:2.0:1783141875.854499:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+59:11579:x1869759492744960:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141875.854525:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141875.854550:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89955f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a010b expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.854631:0:10143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.854643:0:10143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89955f lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a010b expref: 60 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.854667:0:10143:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.854683:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89955f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a010b expref: 60 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.854700:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:2.0:1783141875.854703:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141875.854707:0:10143:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89955f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a010b expref: 60 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141875.854715:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1200, rc 0) 00000100:00100000:2.0:1783141875.854791:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11579:x1869759492744960:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 294us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141875.854798:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 214 00000040:00080000:3.0:1783141876.442869:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141876.442883:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141876.442928:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1783141876.442938:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141876.443094:0:11546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971d9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510554624:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783141876.443251:0:11546:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648503d180 going to sleep for 11 seconds 00010000:00010000:3.0:1783141876.443938:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141876.446645:0:11546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971d9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510554624:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783141876.448393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.448503:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492745088 00000100:00100000:1.0:1783141876.448514:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492745088 00000100:00100000:1.0:1783141876.448583:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 215 00000100:00100000:1.0:1783141876.448595:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11581:x1869759492745088:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783141876.448645:0:7171:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783141876.448768:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11581:x1869759492745088:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 174us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141876.448777:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 215 00000100:00100000:1.0:1783141876.455560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.455730:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492745216 00000100:00100000:2.0:1783141876.455744:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492745216 00000100:00100000:2.0:1783141876.455885:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 216 00000100:00100000:2.0:1783141876.455898:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11581:x1869759492745216:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783141876.455995:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456014:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456029:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456086:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456095:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456101:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456130:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456140:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456148:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141876.456198:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783141876.456229:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141876.456247:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456261:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456268:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456275:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456282:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141876.456296:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456306:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456327:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:2.0:1783141876.456331:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141876.456336:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456342:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899566 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456357:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456363:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456381:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456386:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141876.456456:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456585:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456594:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff94648c722200) 00010000:00010000:2.0:1783141876.456597:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141876.456600:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456606:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89956d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456624:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456631:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456637:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456641:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141876.456644:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456664:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456673:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:2.0:1783141876.456675:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141876.456679:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.456685:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1e00/0x279ffa91da899574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141876.456786:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11581:x1869759492745216:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 887us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.456795:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 216 00000100:00100000:2.0:1783141876.467573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141876.471450:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492745472 00000100:00100000:0.0:1783141876.471554:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492745472 00000100:00100000:0.0:1783141876.471691:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 217 00000100:00100000:0.0:1783141876.471703:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+60:11581:x1869759492745472:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141876.471731:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141876.471757:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89957b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0112 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.471882:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.471900:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.471913:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141876.471926:0:10143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783141876.472042:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.472051:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.472058:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.472064:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.472068:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.472077:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.472102:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141876.472106:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783141876.472112:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.472130:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.472188:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89957b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0112 expref: 62 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.472200:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:0.0:1783141876.472202:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141876.472207:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89957b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0112 expref: 62 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.472228:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6c00, rc 0) 00000100:00100000:0.0:1783141876.472439:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:11581:x1869759492745472:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 737us (4878us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1783141876.472447:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 217 00000100:00100000:1.0:1783141876.478377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141876.478545:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492745600 00000100:00100000:3.0:1783141876.478560:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492745600 00000100:00100000:2.0:1783141876.478696:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 218 00000100:00100000:2.0:1783141876.478709:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:11581:x1869759492745600:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783141876.478786:0:5787:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783141876.478942:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:11581:x1869759492745600:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 235us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.478951:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 218 00000100:00100000:2.0:1783141876.486131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.486614:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492745856 00000100:00100000:1.0:1783141876.486627:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492745856 00000100:00100000:1.0:1783141876.486769:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 219 00000100:00100000:1.0:1783141876.486783:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946489d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:11581:x1869759492745856:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141876.486812:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141876.486816:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783141876.486852:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0800/0x279ffa91da899520 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a00f6 expref: 61 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.486877:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:1.0:1783141876.486882:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141876.486900:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da899590 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0119 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783141876.487560:0:5788:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1783141876.487804:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.487822:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.487834:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.487906:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da899590 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0119 expref: 63 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.487925:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0119 expref: 62 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.487934:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648becad00) 00010000:00010000:1.0:1783141876.487937:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141876.487940:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53000, rc 0) 00000100:00100000:1.0:1783141876.488032:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946489d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+62:11581:x1869759492745856:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1252us (1920us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1783141876.488041:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 219 00000100:00100000:3.0:1783141876.495112:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141876.497021:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492746112 00000100:00100000:0.0:1783141876.497040:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492746112 00000100:00100000:0.0:1783141876.497201:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 220 00000100:00100000:0.0:1783141876.497224:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+62:11581:x1869759492746112:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783141876.497305:0:10143:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141876.497354:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0119 expref: 62 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497401:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648becad00) 00010000:00010000:0.0:1783141876.497418:0:10143:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141876.497444:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497510:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497522:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497539:0:10143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497547:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497556:0:10143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497657:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497664:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497671:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497677:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.497682:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497696:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497705:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:0.0:1783141876.497708:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141876.497713:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497719:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da8995a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497729:0:10143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497735:0:10143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497740:0:10143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497745:0:10143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.497748:0:10143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497754:0:10143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497760:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfd2e62d3 (ffff94648a1adb00) 00010000:00010000:0.0:1783141876.497763:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141876.497765:0:10143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.497783:0:10143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da8995ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfd2e62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141876.497892:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:11581:x1869759492746112:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 678us (2793us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141876.497900:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 220 00000100:00100000:1.0:1783141876.503026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.503229:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492746240 00000100:00100000:2.0:1783141876.503242:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492746240 00000100:00100000:2.0:1783141876.503333:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 221 00000100:00100000:2.0:1783141876.503346:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+61:11581:x1869759492746240:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141876.503394:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141876.503425:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8995b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0120 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.503520:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.503537:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.503551:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.503683:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da8995b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0120 expref: 63 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.503703:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0120 expref: 62 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.503713:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:2.0:1783141876.503716:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783141876.503721:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1c00, rc 0) 00000100:00100000:2.0:1783141876.503800:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+62:11581:x1869759492746240:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 457us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.503808:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 221 00000100:00100000:2.0:1783141876.508345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.508511:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492746496 00000100:00100000:1.0:1783141876.508524:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492746496 00000100:00100000:1.0:1783141876.508640:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 222 00000100:00100000:1.0:1783141876.508651:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+62:11581:x1869759492746496:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783141876.508952:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.508975:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.508989:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783141876.509330:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1783141876.509343:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383713882327ns, next at 384713879062ns, rc = 0 00000004:00010000:1.0:1783141876.509590:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b20e4328 reply state 00000000046f4cc5 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141876.509602:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141876.509748:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+64:11581:x1869759492746496:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 1095us (1413us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1783141876.509757:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 222 00010000:00010000:1.0:1783141876.511617:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.511639:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.511648:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.511655:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141876.511661:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.511695:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.511717:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:1.0:1783141876.511720:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783141876.511726:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.511732:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53400/0x279ffa91da8995c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141876.512932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141876.513250:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492746624 00000100:00100000:0.0:1783141876.513264:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492746624 00000100:00100000:0.0:1783141876.513340:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 223 00000100:00100000:0.0:1783141876.513353:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+63:11581:x1869759492746624:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141876.513386:0:10143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141876.513422:0:10143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0127 expref: -99 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.514287:0:10143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0127 expref: 64 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.514324:0:10143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0127 expref: 64 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.514351:0:10143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:2.0:1783141876.514355:0:10143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141876.514359:0:10143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7000, rc 0) 00000100:00100000:2.0:1783141876.514456:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+64:11581:x1869759492746624:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1104us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.514866:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 223 00000100:00100000:3.0:1783141876.520681:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.520931:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492746752 00000100:00100000:2.0:1783141876.520945:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492746752 00000100:00100000:2.0:1783141876.521097:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:2.0:1783141876.521109:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2368:x1869759492746752:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783141876.521567:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:2368:x1869759492746752:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 458us (1151us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783141876.521576:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00080000:1.0:1783141876.523273:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141876.526056:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.526190:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492747008 00000100:00100000:2.0:1783141876.526203:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492747008 00000100:00100000:2.0:1783141876.526288:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:2.0:1783141876.526300:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+64:11581:x1869759492747008:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783141876.526734:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+65:11581:x1869759492747008:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 435us (691us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1783141876.526743:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 60 00000100:00100000:3.0:1783141876.530654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.530945:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492747264 00000100:00100000:2.0:1783141876.530975:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492747264 00000100:00100000:2.0:1783141876.531048:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 224 00000100:00100000:2.0:1783141876.531060:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+65:11581:x1869759492747264:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783141876.531235:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+65:11581:x1869759492747264:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 176us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.531243:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 224 00000100:00100000:0.0:1783141876.535149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.535600:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492747392 00000100:00100000:1.0:1783141876.535614:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492747392 00000100:00100000:1.0:1783141876.535923:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 225 00000100:00100000:1.0:1783141876.535937:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+65:11581:x1869759492747392:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141876.535964:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141876.535991:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da8995cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a012e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.536084:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da8995d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.536102:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da8995d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.536114:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da8995d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141876.536186:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141876.536209:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da8995d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.537893:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52a00/0x279ffa91da8995cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a012e expref: 67 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.537922:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da8995d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a012e expref: 66 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.537933:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:1.0:1783141876.538802:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783141876.538810:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53600, rc 0) 00000100:00100000:1.0:1783141876.538931:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+66:11581:x1869759492747392:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 2992us (3791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141876.538942:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 225 00000100:00100000:1.0:1783141876.545141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141876.545590:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492747520 00000100:00100000:3.0:1783141876.545605:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492747520 00000100:00100000:3.0:1783141876.545835:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:3.0:1783141876.545848:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9463831b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+10:2368:x1869759492747520:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783141876.545873:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141876.545899:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0135 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141876.545934:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a4895f4, blocks: 0x1 00010000:00010000:3.0:1783141876.545958:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1783141876.545963:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141876.545990:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0135 expref: 11 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.546015:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0135 expref: 11 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.546032:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17400, rc 0) 00000100:00100000:3.0:1783141876.546119:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9463831b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:2368:x1869759492747520:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 273us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141876.546128:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:2.0:1783141876.549637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141876.550052:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492747776 00000100:00100000:0.0:1783141876.550064:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492747776 00000100:00100000:0.0:1783141876.550131:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 226 00000100:00100000:0.0:1783141876.550143:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+66:11581:x1869759492747776:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783141876.550303:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+66:11581:x1869759492747776:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 161us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141876.550311:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 226 00000100:00100000:0.0:1783141876.554603:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.555372:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492747904 00000100:00100000:2.0:1783141876.555386:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492747904 00000100:00100000:2.0:1783141876.555780:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:2.0:1783141876.555794:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:11581:x1869759492747904:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141876.555820:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141876.555843:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a013c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.555883:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0135 expref: 12 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.555893:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141876.555898:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141876.555903:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.555947:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0135 expref: 12 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.555983:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0135 expref: 12 pid: 6587 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141876.555999:0:6584:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6584:1869759510554752:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141876.556129:0:6584:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141876.560441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.561938:0:6584:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6584:1869759510554752:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141876.561986:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.562013:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0200, rc 0) 00000100:00100000:2.0:1783141876.562233:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:11581:x1869759492747904:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 6440us (7643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.562244:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:0.0:1783141876.562269:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492748032 00000100:00100000:0.0:1783141876.562279:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492748032 00010000:00010000:0.0:1783141876.562323:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0135 expref: 12 pid: 6587 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141876.562441:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:0.0:1783141876.562453:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:2369:x1869759492748032:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141876.562511:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141876.562538:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0135 expref: 12 pid: 6587 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.562553:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0135 expref: 12 pid: 6587 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.562580:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062a14495/0x279ffa91da8995dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0135 expref: 12 pid: 6587 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.562598:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141876.562602:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141876.562611:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.564048:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.564127:0:5772:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141876.564147:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba71f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5772:1869759510554880:192.168.203.27@tcp:105: 00000100:00100000:0.0:1783141876.564300:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489ddb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141876.571874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141876.572078:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba71f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5772:1869759510554880:192.168.203.27@tcp:105: 00010000:00010000:0.0:1783141876.572112:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141876.572206:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:2369:x1869759492748032:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 9754us (11779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141876.572237:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:3.0:1783141876.574737:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492748160 00000100:00100000:3.0:1783141876.574829:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492748160 00002000:00100000:3.0:1783141876.574911:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff946485001f80 x1869759492748160/t0(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:252/0 lens 504/0 e 0 to 0 dl 1783141887 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783141876.574923:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946485001f80 with x1869759492748160 ext(0->12) 00002000:00010000:3.0:1783141876.574930:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946485001f80 00000100:00100000:3.0:1783141876.575044:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:3.0:1783141876.575057:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+11:2368:x1869759492748160:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783141876.576942:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:2368:x1869759492748160:12345-192.168.203.27@tcp:4:lhsmtool_posix.0 Request processed in 1874us (5070us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1783141876.576958:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00002000:00100000:1.0:1783141876.576973:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff946485001f80 x1869759492748160/t4294967320(0) o4->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:252/0 lens 504/448 e 0 to 0 dl 1783141887 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783141876.576985:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946485001f80 with x1869759492748160 ext(0->12) 00002000:00010000:1.0:1783141876.576992:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946485001f80 00000100:00100000:2.0:1783141876.580433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141876.581000:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492748288 00000100:00100000:3.0:1783141876.581013:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492748288 00000100:00100000:3.0:1783141876.581085:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 227 00000100:00100000:3.0:1783141876.581097:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+66:11581:x1869759492748288:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1783141876.641189:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+66:11581:x1869759492748288:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 60077us (60762us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141876.641206:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 227 00000001:00080000:1.0:1783141876.641266:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:1.0:1783141876.641302:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1783141876.641307:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:1.0:1783141876.641368:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1783141876.641385:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1783141876.641407:0:5809:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9464868990c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1783141876.641413:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9464bff53a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946486899000 00000020:00080000:1.0:1783141876.641416:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9464bff53300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9464ba9c5000 00000004:00080000:1.0:1783141876.641517:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1783141876.641531:0:5809:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94648beb10c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1783141876.641536:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff946482e3cb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9464852a80c0 00000020:00080000:1.0:1783141876.641539:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff946482e3c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9463812ff400 00000100:00100000:2.0:1783141876.641618:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510555008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783141876.641690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783141876.641742:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1783141876.641779:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510555264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783141876.641815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141876.641849:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783141876.641858:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510555136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783141876.641897:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141876.641946:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510555008 00000100:00100000:2.0:1783141876.641954:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510555008 00000020:00080000:1.0:1783141876.642018:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1783141876.642030:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510555264 00000100:00100000:2.0:1783141876.642036:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510555264 00000100:00080000:1.0:1783141876.642042:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141876.642058:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510555136 00000100:00100000:2.0:1783141876.642064:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510555136 00000100:00100000:2.0:1783141876.642081:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783141876.642089:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1869759510555008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783141876.642128:0:6586:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1783141876.642153:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.642176:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a009b expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.642186:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783141876.642191:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141876.642197:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.642239:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a009b expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.642254:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a009b expref: 12 pid: 6584 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141876.642276:0:6586:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6586:1869759510555392:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141876.642335:0:6586:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a34f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783141876.642361:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783141876.642381:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1869759510555264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783141876.642399:0:10144:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1783141876.642423:0:10144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a4895f2, atime: 0x6a4895f3, ctime: 0x6a4895f2, blocks: 0x1 00010000:00010000:2.0:1783141876.642430:0:10144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.642439:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1783141876.642442:0:10144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141876.642448:0:10144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.642503:0:10144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.642514:0:10144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.642522:0:10144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.642552:0:10144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783141876.643086:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1869759510555264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 707us (1269us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783141876.643092:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783141876.643111:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783141876.643122:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1869759510555136:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1783141876.643166:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946485000e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783141876.643181:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510555264:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1783141876.643251:0:10144:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783141876.643255:0:10144:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783141876 00002000:00010000:2.0:1783141876.643258:0:10144:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783141876.643260:0:10144:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783141876 -> 1783141876 00002000:00010000:2.0:1783141876.643262:0:10144:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783141876.643303:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1869759510555136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (1404us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1783141876.643310:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1783141876.643390:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946496b24e00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1783141876.643399:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510555136:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1783141876.643555:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141876.643564:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.643573:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1e00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141876.643578:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.643600:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.643619:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.643627:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001976c159/0x279ffa91da8995f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.643647:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141876.643648:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141876.643650:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141876.646250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141876.647065:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492748416 00000100:00100000:3.0:1783141876.647083:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492748416 00000100:00100000:3.0:1783141876.647177:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:3.0:1783141876.647190:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:2369:x1869759492748416:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783141876.654550:0:6586:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6586:1869759510555392:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141876.654581:0:6586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141876.654697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.654722:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492748544 00000100:00100000:1.0:1783141876.654729:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492748544 00010000:00010000:1.0:1783141876.654765:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a009b expref: 14 pid: 6584 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141876.654800:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:1.0:1783141876.654809:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+14:2369:x1869759492748544:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141876.654840:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141876.654846:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a009b expref: 14 pid: 6584 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.654858:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a009b expref: 14 pid: 6584 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.654889:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023e1e456/0x279ffa91da8993ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a009b expref: 14 pid: 6584 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.655085:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141876.655090:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783141876.655096:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.655107:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.655133:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141876.655192:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+13:2369:x1869759492748544:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 383us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141876.655201:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 81 00010000:00010000:1.0:1783141876.655352:0:6586:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.655362:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.655379:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.655387:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.655404:0:6586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783141876.656239:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1869759510555008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14146us (14546us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1783141876.656250:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1783141876.657081:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141876.657091:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.657103:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141876.657108:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.657119:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.657136:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.657144:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8995eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.657249:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141876.657252:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141876.657254:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783141876.659785:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946496b25f80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1783141876.659799:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510555008:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1783141876.753079:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1783141876.753107:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1783141876.753605:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+12:2369:x1869759492748416:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 106408us (107353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.753620:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 68 00000001:00080000:3.0:1783141876.754224:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1783141876.754238:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1783141876.768349:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.768615:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492748800 00000100:00100000:1.0:1783141876.768628:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492748800 00000100:00100000:1.0:1783141876.768702:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 228 00000100:00100000:1.0:1783141876.768715:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11581:x1869759492748800:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783141876.768905:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141876.768943:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53600/0x279ffa91da8995d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a012e expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.768969:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:1.0:1783141876.768975:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783141876.769014:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.769030:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.769042:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141876.769780:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ae129e5 reply state 0000000099d51d21 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141876.769815:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783141876.769964:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:11581:x1869759492748800:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 1249us (1628us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1783141876.769973:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 228 00010000:00010000:3.0:1783141876.776057:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.776080:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.776088:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.776095:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141876.776101:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.776118:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.776141:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:3.0:1783141876.776145:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141876.776149:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.776156:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52600/0x279ffa91da8995f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141876.776832:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141876.777192:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492748928 00000100:00100000:3.0:1783141876.777205:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492748928 00000100:00100000:3.0:1783141876.777283:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:3.0:1783141876.777316:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492748928:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783141876.777627:0:10144:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783141876.777632:0:10144:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1783141876 -> 1783141875 00002000:00010000:3.0:1783141876.777634:0:10144:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783141875 00002000:00010000:3.0:1783141876.777636:0:10144:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783141876 -> 1783141875 00002000:00010000:3.0:1783141876.777638:0:10144:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783141876.777717:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba7cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2369:x1869759492748928:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 402us (892us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1783141876.777726:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:1.0:1783141876.783265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.783438:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492749184 00000100:00100000:2.0:1783141876.783451:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492749184 00000100:00100000:2.0:1783141876.783559:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 229 00000100:00100000:2.0:1783141876.783572:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11581:x1869759492749184:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783141876.783668:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.783688:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0120 expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.783699:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.783741:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0120 expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.783973:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0120 expref: 20 pid: 5787 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141876.784058:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510555520:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141876.784231:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487f67e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141876.791836:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510555520:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141876.791878:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141876.795741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.797718:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492749312 00000100:00100000:2.0:1783141876.797737:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492749312 00010000:00010000:2.0:1783141876.797804:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0120 expref: 21 pid: 5787 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141876.797917:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:2.0:1783141876.797928:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:2368:x1869759492749312:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141876.797949:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141876.797957:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0120 expref: 21 pid: 5787 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.797974:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0120 expref: 21 pid: 5787 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.798004:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da8995ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0120 expref: 21 pid: 5787 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.798047:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:2.0:1783141876.798053:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.798064:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.798076:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.798117:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141876.800683:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.800703:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.800746:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.800753:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.800761:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.800768:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.800793:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.800801:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.800822:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:0.0:1783141876.800825:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783141876.800829:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.800836:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899600 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141876.801371:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:11581:x1869759492749184:12345-192.168.203.27@tcp:55:lhsmtool_posix.0 Request processed in 17794us (18113us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783141876.801383:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 229 00000100:00100000:2.0:1783141876.801488:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:2368:x1869759492749312:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 3530us (5730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.801499:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:1.0:1783141876.805781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.805875:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492749440 00000100:00100000:2.0:1783141876.805888:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492749440 00000100:00100000:2.0:1783141876.805957:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:2.0:1783141876.805971:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2369:x1869759492749440:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783141876.806031:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.806055:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.806064:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783141876.806069:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141876.806074:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.806147:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.806163:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 8 pid: 6584 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141876.806183:0:6586:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6586:1869759510555648:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141876.806314:0:6586:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487f67e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141876.810562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141876.810679:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492749568 00000100:00100000:0.0:1783141876.810692:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492749568 00010000:00010000:0.0:1783141876.810745:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 9 pid: 6584 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141876.810798:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00100000:0.0:1783141876.810809:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2369:x1869759492749568:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141876.810829:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141876.810857:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 9 pid: 6584 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.810874:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 9 pid: 6584 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.810928:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141876.810933:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783141876.810939:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.810951:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.810976:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141876.811047:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+9:2369:x1869759492749568:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 239us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141876.811057:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 83 00010000:00010000:1.0:1783141876.811179:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8995e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a013c expref: 8 pid: 6584 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141876.811198:0:6586:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6586:1869759510555648:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141876.811234:0:6586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.811246:0:6586:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.811253:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.811283:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.811292:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.811315:0:6586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.811322:0:6586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141876.811327:0:6586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.811338:0:6586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.811351:0:6586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.811359:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c0bba46/0x279ffa91da899607 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141876.811413:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492749440:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 5445us (5646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141876.811423:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 70 00000100:00100000:1.0:1783141876.814525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141876.814665:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492749824 00000100:00100000:3.0:1783141876.814678:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492749824 00000100:00100000:3.0:1783141876.814734:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 230 00000100:00100000:3.0:1783141876.814744:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:11581:x1869759492749824:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783141876.814845:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.814866:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.814880:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.815131:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.815143:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0127 expref: 20 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.815172:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.815225:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0127 expref: 20 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.815242:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0127 expref: 20 pid: 10143 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141876.815260:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510555776:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141876.815373:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648503d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783141876.817846:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510555776:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141876.817884:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141876.819874:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141876.820450:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492749952 00000100:00100000:3.0:1783141876.820512:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492749952 00010000:00010000:3.0:1783141876.820578:0:7493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0127 expref: 21 pid: 10143 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141876.820629:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:3.0:1783141876.820640:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:2369:x1869759492749952:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141876.820657:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141876.820664:0:7493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0127 expref: 21 pid: 10143 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.820677:0:7493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0127 expref: 21 pid: 10143 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.820704:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da8995c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0127 expref: 21 pid: 10143 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.820732:0:7493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:3.0:1783141876.820739:0:7493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.820751:0:7493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.820759:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.820792:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141876.820866:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:2369:x1869759492749952:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 226us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141876.820875:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 84 00010000:00010000:0.0:1783141876.820965:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.820974:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141876.821236:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1783141876.821570:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1783141876.821622:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1783141876.821720:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba71dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1869759510555904:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783141876.821794:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141876.821836:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489ddbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783141876.822956:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510555904 00000100:00100000:3.0:1783141876.822969:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510555904 00000100:00100000:3.0:1783141876.823049:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783141876.823061:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5786:x1869759510555904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783141876.823193:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5786:x1869759510555904:12345-0@lo:1000:mdt00_000.0 Request processed in 134us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141876.823201:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141876.823305:0:5786:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1783141876.823314:0:5786:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1783141876.823342:0:5786:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946496b24e00, transno 4294967321 00000100:00100000:0.0:1783141876.823378:0:5786:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff946496b25f80 x1869759510555008/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783141892 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141876.823392:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba71dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1869759510555904:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1783141876.823953:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1783141876.824043:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba71dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1869759510556032:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783141876.824091:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141876.824124:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489ddb540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141876.824152:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510556032 00000100:00100000:0.0:1783141876.824158:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510556032 00000100:00100000:0.0:1783141876.824188:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141876.824196:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5786:x1869759510556032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783141876.824411:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5786:x1869759510556032:12345-0@lo:1000:mdt00_000.0 Request processed in 215us (319us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1783141876.824419:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141876.824481:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba71dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1869759510556032:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1783141876.824518:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824529:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824537:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824544:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.824549:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824570:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824590:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648c722200) 00010000:00010000:0.0:1783141876.824594:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141876.824600:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824606:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899615 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824642:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824648:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824653:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824658:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.824661:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824667:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824675:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141876.824677:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141876.824685:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89955f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a010b expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824710:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89955f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a010b expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824721:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89955f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a010b expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.824751:0:5786:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89955f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a010b expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141876.824764:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba71ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510556160:192.168.203.27@tcp:105: 00000100:00100000:0.0:1783141876.824847:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a346c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141876.830009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.830438:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492750080 00000100:00100000:2.0:1783141876.830449:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492750080 00000100:00100000:1.0:1783141876.830662:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:1.0:1783141876.830675:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11579:x1869759492750080:12345-192.168.203.27@tcp:49:lfs.0 00000100:00100000:1.0:1783141876.830841:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11579:x1869759492750080:12345-192.168.203.27@tcp:49:lfs.0 Request processed in 169us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141876.830849:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 61 00000100:00100000:3.0:1783141876.833402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.833696:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492750336 00000100:00100000:1.0:1783141876.833707:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492750336 00000100:00100000:1.0:1783141876.833781:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 231 00000100:00100000:1.0:1783141876.833792:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11579:x1869759492750336:12345-192.168.203.27@tcp:58:lfs.0 00000040:00080000:1.0:1783141876.834756:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1783141876.834874:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11579:x1869759492750336:12345-192.168.203.27@tcp:58:lfs.0 Request processed in 1079us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141876.834886:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 231 00000100:00100000:0.0:1783141876.839088:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba71ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1869759510556160:192.168.203.27@tcp:105: 00010000:00010000:0.0:1783141876.839141:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839154:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899558 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839219:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839236:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839249:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839262:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839298:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839304:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839311:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.839316:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839324:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839336:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141876.839339:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141876.839343:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839349:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89961c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839361:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839366:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839372:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839378:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.839388:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839394:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839403:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141876.839405:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783141876.839408:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.839414:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16600/0x279ffa91da89960e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783141876.840177:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141876.840184:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141876.840232:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1783141876.840241:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783141876.840385:0:11546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971dbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510556288:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783141876.840514:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11581:x1869759492749824:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 25768us (25998us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1783141876.840528:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 230 00000020:00080000:0.0:1783141876.840545:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783141876.845518:0:11546:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648503d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141876.864102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.864196:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492750592 00000100:00100000:1.0:1783141876.864216:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492750592 00000100:00100000:1.0:1783141876.864293:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:1.0:1783141876.864304:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+24:11581:x1869759492750592:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783141876.865082:0:5790:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783141876.865197:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1783141876.865263:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.865282:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.865295:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.865314:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.865321:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.865327:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.865342:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783141876.865490:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1ee9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+26:11581:x1869759492750592:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 1157us (1371us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1783141876.865500:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 62 00000020:00080000:1.0:1783141876.865507:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783141876.865846:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141876.865855:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.865864:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141876.865869:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.865878:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.865894:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94648beca600) 00010000:00010000:3.0:1783141876.865897:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783141876.865906:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.865913:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52c00/0x279ffa91da899623 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141876.865932:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141876.865934:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141876.865936:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141876.866954:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141876.867093:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492750720 00000100:00100000:0.0:1783141876.867105:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492750720 00000100:00100000:2.0:1783141876.867125:0:11546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971dbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1869759510556288:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783141876.867167:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:0.0:1783141876.867178:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+25:11583:x1869759492750720:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141876.867202:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141876.867242:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89962a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0143 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867322:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867338:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867364:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867379:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867386:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867393:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867711:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867723:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0104 expref: 26 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867730:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867770:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0104 expref: 26 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.867785:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0104 expref: 26 pid: 7171 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141876.867801:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba71ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510556416:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141876.867898:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141876.870415:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.870561:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492750848 00000100:00100000:2.0:1783141876.870574:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492750848 00000100:00100000:2.0:1783141876.870644:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 233 00000100:00100000:2.0:1783141876.870656:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:11585:x1869759492750848:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783141876.870699:0:7171:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783141876.870831:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:11585:x1869759492750848:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 176us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.870840:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 233 00000100:00100000:3.0:1783141876.872861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.873051:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492751104 00000100:00100000:1.0:1783141876.873062:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492751104 00000100:00100000:1.0:1783141876.873137:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:1.0:1783141876.873148:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+27:5578:x1869759492751104:12345-192.168.203.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783141876.873445:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:5578:x1869759492751104:12345-192.168.203.27@tcp:35:ldlm_bl.0 Request processed in 298us (592us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1783141876.873453:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 63 00000100:00100000:3.0:1783141876.874807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141876.874945:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492751360 00000100:00100000:1.0:1783141876.874955:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492751360 00000100:00100000:1.0:1783141876.875012:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 234 00000100:00100000:1.0:1783141876.875024:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:11585:x1869759492751360:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141876.875046:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141876.875072:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899646 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a014a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.875227:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89964d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.875246:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89964d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.875259:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89964d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141876.875273:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783141876.875422:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53000/0x279ffa91da899646 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a014a expref: 31 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.875445:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89964d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a014a expref: 30 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.875456:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141876.875503:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783141876.875507:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.875515:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141876.875523:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52400, rc 0) 00000100:00100000:1.0:1783141876.876021:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:11585:x1869759492751360:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 996us (1218us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1783141876.876031:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 234 00000100:00100000:3.0:1783141876.876679:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141876.877318:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492751488 00000100:00100000:2.0:1783141876.877330:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492751488 00010000:00010000:2.0:1783141876.877374:0:6600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0104 expref: 30 pid: 7171 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141876.877434:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:2.0:1783141876.877444:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:2366:x1869759492751488:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141876.877489:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141876.877498:0:6600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0104 expref: 30 pid: 7171 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.877512:0:6600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0104 expref: 30 pid: 7171 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.877548:0:6600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:2.0:1783141876.877555:0:6600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.877566:0:6600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.877575:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.877598:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141876.877653:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:2366:x1869759492751488:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 209us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141876.877661:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 85 00010000:00010000:0.0:1783141876.880354:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17c00/0x279ffa91da89954a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0104 expref: 29 pid: 7171 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141876.880383:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba71ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1869759510556416:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141876.880411:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880667:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880675:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141876.880739:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783141876.880744:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141876.880784:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880802:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880814:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880821:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880829:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880836:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.880840:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880868:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880886:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:0.0:1783141876.880890:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141876.880894:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880900:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880913:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880920:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880926:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880932:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141876.880934:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880940:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880948:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94648a1adb00) 00010000:00010000:0.0:1783141876.880951:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141876.880954:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.880969:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899638 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141876.880977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00010000:00010000:0.0:1783141876.881020:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6c00/0x279ffa91da89962a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0143 expref: 29 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.881035:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0143 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141876.881044:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141876.881047:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783141876.881049:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6a00, rc 0) 00000100:00100000:2.0:1783141876.881060:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492751744 00000100:00100000:2.0:1783141876.881067:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492751744 00000100:00100000:0.0:1783141876.881109:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:11583:x1869759492750720:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 13933us (14162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141876.881116:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:2.0:1783141876.881123:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 235 00000100:00100000:2.0:1783141876.881133:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+28:11585:x1869759492751744:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783141876.881232:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.881246:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.881253:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.881648:0:7171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.881656:0:7171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.881662:0:7171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.881667:0:7171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141876.881670:0:7171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.881676:0:7171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.881684:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:2.0:1783141876.881687:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783141876.881690:0:7171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141876.881694:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1c00/0x279ffa91da89965b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141876.881832:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:11585:x1869759492751744:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 699us (1556us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1783141876.881840:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 235 00000040:00080000:3.0:1783141876.882712:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141876.882730:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141876.883183:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783141876.883192:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141876.887016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141876.887241:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492752000 00000100:00100000:3.0:1783141876.887255:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492752000 00000100:00100000:3.0:1783141876.887323:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 64 00000100:00100000:3.0:1783141876.887334:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+29:11585:x1869759492752000:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783141876.888791:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:11585:x1869759492752000:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 1446us (1778us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783141876.888806:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 64 00000001:00080000:1.0:1783141877.346622:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1783141877.346649:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1783141877.346658:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1783141877.466652:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783141877.583172:0:12374:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141877.583180:0:12374:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141877.583223:0:12374:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783141877.583230:0:12374:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783141877.760756:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141877.760862:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492752256 00000100:00100000:0.0:1783141877.760871:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492752256 00000100:00100000:0.0:1783141877.760944:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 236 00000100:00100000:0.0:1783141877.760955:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+30:11607:x1869759492752256:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141877.760978:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141877.760997:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0151 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141877.761093:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899669 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141877.761107:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141877.761131:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899669 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141877.761144:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783141877.761275:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0151 expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141877.761305:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899669 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0151 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141877.761314:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:0.0:1783141877.761316:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783141877.761320:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7600, rc 0) 00000100:00100000:0.0:1783141877.761380:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11607:x1869759492752256:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 427us (632us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1783141877.761388:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 236 00000100:00080000:1.0:1783141877.761644:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141877.768658:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141877.768760:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492752384 00000100:00100000:2.0:1783141877.768771:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492752384 00000100:00100000:2.0:1783141877.768831:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 237 00000100:00100000:2.0:1783141877.768841:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11607:x1869759492752384:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:2.0:1783141877.768906:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141877.768923:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141877.768934:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141877.768958:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141877.768964:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141877.768970:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141877.768987:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141877.768992:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141877.768999:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141877.769011:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:2.0:1783141877.769013:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141877.769018:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141877.769024:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da899677 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141877.769096:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11607:x1869759492752384:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 256us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141877.769104:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 237 00000100:00100000:3.0:1783141877.786735:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510556672:0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.786741:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510556800:0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.786839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141877.786884:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510556800 00000100:00100000:3.0:1783141877.786895:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510556800 00000100:00100000:2.0:1783141877.786929:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783141877.786938:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510556928:0@lo:400:kworker.0 00000100:00100000:3.0:1783141877.786978:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783141877.786986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141877.786996:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510556800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.787034:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510556928 00000100:00100000:2.0:1783141877.787043:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510556928 00000100:00100000:3.0:1783141877.787088:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510556800:12345-0@lo:400:kworker.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141877.787096:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783141877.787104:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783141877.787116:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510556928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.787172:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510556928:12345-0@lo:400:kworker.0 Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141877.787192:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783141877.787227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141877.787256:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783141877.787262:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510556544:0@lo:400:kworker.0 00000100:00100000:3.0:1783141877.787286:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510556672 00000100:00100000:3.0:1783141877.787293:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510556672 00000100:00100000:3.0:1783141877.787325:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783141877.787332:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510556672:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783141877.787541:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141877.787547:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141877.788792:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1869759510556672:12345-0@lo:400:kworker.0 Request processed in 1450us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141877.788806:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783141877.791558:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141877.791572:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1783141877.791585:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1783141877.791614:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946485000e00, transno 4294967310 00000100:00100000:3.0:1783141877.791663:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510556928:0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.792007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141877.792063:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510557056:0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.792107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141877.792150:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1869759510556672:0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.792180:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510556544 00000100:00100000:2.0:1783141877.792186:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510556544 00000100:00100000:2.0:1783141877.792241:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1783141877.792249:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3306:x1869759510556544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.792860:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:872ec41a-f648-467b-b036-39669ac398c4+19:3306:x1869759510556544:12345-0@lo:400:kworker.0 Request processed in 609us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141877.792870:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1783141877.792988:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510556544:0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.793012:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510557056 00000100:00100000:2.0:1783141877.793016:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510557056 00000100:00100000:2.0:1783141877.793055:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783141877.793062:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510557056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141877.793100:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510557056:12345-0@lo:400:kworker.0 Request processed in 39us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141877.793107:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1783141877.793121:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141877.793140:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510557056:0@lo:400:kworker.0 00000100:00100000:1.0:1783141877.794389:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510557184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141877.794635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141877.795288:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510556800:0@lo:400:kworker.0 00000100:00100000:0.0:1783141877.796870:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510557184 00000100:00100000:0.0:1783141877.796883:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510557184 00000100:00100000:0.0:1783141877.796950:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783141877.796960:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510557184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141877.796995:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141877.797071:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510557184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (2436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141877.797078:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783141877.797415:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510557184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141877.847403:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141877.847517:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492752512 00000100:00100000:3.0:1783141877.847541:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492752512 00000100:00100000:3.0:1783141877.847620:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:3.0:1783141877.847632:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2367:x1869759492752512:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:3.0:1783141877.847656:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141877.847681:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004315efb2/0x279ffa91da89967e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0158 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783141877.847715:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a4895f3, atime: 0x6a4895f3, ctime: 0x6a4895f3, blocks: 0xb 00010000:00010000:3.0:1783141877.847739:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:3.0:1783141877.847743:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141877.847754:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004315efb2/0x279ffa91da89967e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0158 expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141877.847775:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004315efb2/0x279ffa91da89967e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0158 expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141877.847789:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16800, rc 0) 00000100:00100000:3.0:1783141877.847872:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2367:x1869759492752512:12345-192.168.203.27@tcp:101:cat.0 Request processed in 243us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141877.847880:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 71 00000100:00100000:1.0:1783141877.852786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141877.852904:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492752640 00000100:00100000:0.0:1783141877.852918:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492752640 00002000:00100000:0.0:1783141877.853005:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff946485002680 x1869759492752640/t0(0) o3->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:253/0 lens 488/0 e 0 to 0 dl 1783141888 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141877.853018:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946485002680 with x1869759492752640 ext(0->4095) 00002000:00010000:0.0:1783141877.853025:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946485002680 00000100:00100000:0.0:1783141877.853123:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:0.0:1783141877.853135:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2366:x1869759492752640:12345-192.168.203.27@tcp:3:cat.0 00000100:00100000:0.0:1783141877.853649:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+8:2366:x1869759492752640:12345-192.168.203.27@tcp:3:cat.0 Request processed in 513us (875us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783141877.853659:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00002000:00100000:0.0:1783141877.853668:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff946485002680 x1869759492752640/t0(0) o3->8c7e4ac0-9090-4366-bd86-d237f38a8cf1@192.168.203.27@tcp:253/0 lens 488/4536 e 0 to 0 dl 1783141888 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783141877.853676:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff946485002680 with x1869759492752640 ext(0->4095) 00002000:00010000:0.0:1783141877.853680:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946485002680 00000100:00100000:0.0:1783141877.980767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141877.980817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141877.980857:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141877.980932:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492752896 00000100:00100000:2.0:1783141877.980945:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492752896 00000100:00100000:1.0:1783141877.980965:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492753024 00000100:00100000:1.0:1783141877.980972:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492753024 00000100:00100000:3.0:1783141877.981032:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492752768 00000100:00100000:3.0:1783141877.981037:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492752768 00000100:00100000:2.0:1783141877.981052:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:2.0:1783141877.981065:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492752896:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141877.981079:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 295 00000100:00100000:3.0:1783141877.981115:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492752768:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141877.981223:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2367:x1869759492752896:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141877.981232:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:1.0:1783141877.982684:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00100000:1.0:1783141877.982700:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492753024:12345-192.168.203.27@tcp:400:kworker.0 00000100:00080000:0.0:1783141877.983018:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783141877.983026:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783141877.984674:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492752768:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 3552us (3906us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141877.984692:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 295 00000100:00100000:1.0:1783141877.994043:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2367:x1869759492753024:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 10618us (12496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141877.994065:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00100000:0.0:1783141878.298871:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141878.298913:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510557312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141878.299036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141878.299220:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510557312 00000100:00100000:1.0:1783141878.299241:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510557312 00000100:00100000:1.0:1783141878.299314:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783141878.299326:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba1f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1869759510557312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141878.299386:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141878.299442:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba1f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1869759510557312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141878.299503:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1783141878.299853:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783141878.299909:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510557312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783141878.490662:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141879.515288:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141880.538794:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141881.562561:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141881.766658:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141881.766966:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492753152 00000100:00100000:2.0:1783141881.766975:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492753152 00000100:00100000:2.0:1783141881.767080:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 238 00000100:00100000:2.0:1783141881.767091:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11267:x1869759492753152:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783141881.767229:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11267:x1869759492753152:12345-192.168.203.27@tcp:60:lhsmtool_posix.0 Request processed in 140us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141881.767237:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 238 00000100:00080000:0.0:1783141881.768564:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141881.778188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141881.778647:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492753408 00000100:00100000:0.0:1783141881.778661:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492753408 00000100:00100000:0.0:1783141881.778734:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 65 00000100:00100000:0.0:1783141881.778747:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+32:11267:x1869759492753408:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783141881.779502:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+33:11267:x1869759492753408:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 709us (1288us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1783141881.779514:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 65 00000001:00080000:1.0:1783141881.941236:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1783141881.941262:0:5809:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946489ddbd80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1783141881.941269:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff94649740d800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946489ddb180 00000020:00080000:1.0:1783141881.941273:0:5809:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff94649740d700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff946489d5f400 00000020:00080000:2.0:1783141881.941309:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1783141881.941322:0:5809:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1783141881.941560:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1783141881.945817:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141881.947420:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492753536 00000100:00100000:2.0:1783141881.947438:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492753536 00000100:00100000:2.0:1783141881.947561:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 239 00000100:00100000:2.0:1783141881.947573:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+5:12058:x1869759492753536:12345-192.168.203.27@tcp:101:lsof.0 00010000:00010000:2.0:1783141881.947669:0:7171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141881.947698:0:7171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a015f expref: -99 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783141881.947769:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783141881.947874:0:7171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89968c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141881.947892:0:7171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89968c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141881.947906:0:7171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89968c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141881.948204:0:7171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783141881.948209:0:7171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141881.948454:0:7171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89968c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141881.948509:0:7171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0200/0x279ffa91da899685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a015f expref: 7 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141881.948724:0:7171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89968c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a015f expref: 6 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141881.948736:0:7171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722d00) 00010000:00010000:2.0:1783141881.948740:0:7171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141881.948744:0:7171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1800, rc 0) 00000100:00100000:2.0:1783141881.948832:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20702fa5-92e9-446c-b215-c14c139e5a0c+6:12058:x1869759492753536:12345-192.168.203.27@tcp:101:lsof.0 Request processed in 1260us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141881.948841:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 239 00000001:00080000:0.0:1783141881.957085:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1783141881.957115:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:2.0:1783141882.586805:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141882.910194:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510557824:0@lo:400:kworker.0 00000100:00100000:1.0:1783141882.910208:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510557568:0@lo:400:kworker.0 00000100:00100000:0.0:1783141882.910378:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510557696:0@lo:400:kworker.0 00000100:00100000:2.0:1783141882.910570:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510557440:0@lo:400:kworker.0 00000100:00100000:3.0:1783141882.915990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141882.916277:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510557824 00000100:00100000:3.0:1783141882.916289:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510557824 00000100:00100000:3.0:1783141882.916386:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783141882.916399:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510557824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141882.916512:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510557824:12345-0@lo:400:kworker.0 Request processed in 116us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141882.916520:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783141882.916575:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510557824:0@lo:400:kworker.0 00000100:00080000:3.0:1783141882.916623:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783141882.917634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141882.917687:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510557696 00000100:00100000:0.0:1783141882.917694:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510557696 00000100:00100000:0.0:1783141882.917748:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783141882.917758:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510557696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141882.917809:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1869759510557696:12345-0@lo:400:kworker.0 Request processed in 53us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141882.917815:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783141882.917856:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510557696:0@lo:400:kworker.0 00000100:00100000:0.0:1783141882.917870:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510558208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141882.917907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141882.918494:0:8073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510558208 00000100:00100000:3.0:1783141882.918501:0:8073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510558208 00000100:00100000:3.0:1783141882.918553:0:8073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783141882.918561:0:8073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510558208:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783141882.918593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1783141882.918602:0:8073:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141882.918646:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510558080:0@lo:400:kworker.0 00000100:00100000:3.0:1783141882.918654:0:8073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510558208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141882.918662:0:8073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783141882.918684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141882.918687:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510557568 00000100:00100000:3.0:1783141882.918692:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510557568 00000100:00100000:3.0:1783141882.918726:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783141882.918751:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510557568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783141882.918757:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141882.918795:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510557568:12345-0@lo:400:kworker.0 Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141882.918803:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783141882.918842:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510558080 00000100:00100000:3.0:1783141882.918845:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510558080 00000100:00100000:1.0:1783141882.918877:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510557568:0@lo:400:kworker.0 00000100:00100000:3.0:1783141882.918884:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783141882.918893:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510558080:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783141882.918914:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141882.918942:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510558080:12345-0@lo:400:kworker.0 Request processed in 50us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141882.918950:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783141882.918965:0:3305:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1783141882.918972:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946496b25f80, transno 4294967322 00000004:00080000:1.0:1783141882.918983:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1783141882.919003:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510558080:0@lo:400:kworker.0 00000100:00100000:0.0:1783141882.919211:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510558208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783141882.926641:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141882.926736:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510557952:0@lo:400:kworker.0 00000100:00100000:2.0:1783141882.926793:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141882.927036:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510557440 00000100:00100000:3.0:1783141882.927047:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510557440 00000100:00100000:3.0:1783141882.927148:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783141882.927161:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510557440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141882.927255:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510557440:12345-0@lo:400:kworker.0 Request processed in 96us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141882.927264:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1783141882.927365:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510557440:0@lo:400:kworker.0 00000100:00100000:0.0:1783141882.927532:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510557952 00000100:00100000:0.0:1783141882.927554:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510557952 00000100:00100000:0.0:1783141882.927600:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783141882.927608:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510557952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141882.927657:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510557952:12345-0@lo:400:kworker.0 Request processed in 49us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141882.927664:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1783141882.927746:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141882.927774:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510557952:0@lo:400:kworker.0 00000100:00100000:3.0:1783141883.096825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141883.096886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141883.096927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141883.097021:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141883.097034:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492753920 00000100:00100000:0.0:1783141883.097052:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492753920 00000100:00100000:1.0:1783141883.097093:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492753664 00000100:00100000:1.0:1783141883.097117:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492753664 00000100:00100000:0.0:1783141883.097139:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00100000:0.0:1783141883.097154:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492753920:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141883.097160:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 297 00000100:00100000:1.0:1783141883.097180:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492753664:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141883.097263:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2369:x1869759492753664:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 85us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141883.097272:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 297 00000100:00080000:1.0:1783141883.097338:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141883.098975:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492754176 00000100:00100000:2.0:1783141883.098990:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492754176 00000100:00100000:2.0:1783141883.099062:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492753792 00000100:00100000:2.0:1783141883.099066:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492753792 00000100:00100000:0.0:1783141883.099198:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2369:x1869759492753920:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 2041us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141883.099213:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00080000:0.0:1783141883.099268:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141883.099315:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 156 00000100:00100000:1.0:1783141883.099328:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2369:x1869759492754176:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141883.099404:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2369:x1869759492754176:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 79us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141883.099411:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 156 00000100:00100000:2.0:1783141883.099767:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 157 00000100:00100000:2.0:1783141883.099775:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:2369:x1869759492753792:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141883.099816:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:2369:x1869759492753792:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 42us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141883.099822:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 157 00000100:00080000:1.0:1783141883.099883:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141883.100207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141883.100650:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492754048 00000100:00100000:1.0:1783141883.100659:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492754048 00000100:00100000:1.0:1783141883.100755:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:1.0:1783141883.100765:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492754048:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141883.100818:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2369:x1869759492754048:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 55us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141883.100826:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00080000:2.0:1783141883.100877:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141883.420704:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783141883.420742:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510558336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141883.420839:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141883.420994:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510558336 00000100:00100000:0.0:1783141883.421006:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510558336 00000100:00100000:0.0:1783141883.421087:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783141883.421100:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510558336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783141883.421147:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141883.421220:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510558336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141883.421229:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783141883.421273:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510558336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783141883.610720:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141884.634971:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141884.648383:0:12575:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:11:23 (1783141883) 00000040:00080000:2.0:1783141885.083436:0:11546:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783141885.083449:0:11546:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783141885.083852:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783141885.083863:0:11546:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783141885.666406:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141886.685429:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783141887.066417:0:5809:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783141887.066512:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1783141887.066531:0:5820:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1783141887.706925:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141887.977016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141887.977159:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492754432 00000100:00100000:0.0:1783141887.977172:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492754432 00000100:00100000:0.0:1783141887.977272:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00100000:0.0:1783141887.977287:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+19:12280:x1869759492754432:12345-192.168.203.27@tcp:35:umount.0 00000100:00100000:0.0:1783141887.978193:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:12280:x1869759492754432:12345-192.168.203.27@tcp:35:umount.0 Request processed in 904us (1187us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1783141887.978215:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 66 00000100:00080000:2.0:1783141887.978861:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141887.983404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141887.983822:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492754688 00000100:00100000:2.0:1783141887.983836:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492754688 00000100:00100000:2.0:1783141887.983916:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:2.0:1783141887.983928:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+20:12280:x1869759492754688:12345-192.168.203.27@tcp:35:umount.0 00000100:00100000:2.0:1783141887.984880:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:12280:x1869759492754688:12345-192.168.203.27@tcp:35:umount.0 Request processed in 945us (1482us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1783141887.984893:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 67 00000100:00100000:3.0:1783141887.992947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141887.993172:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492754944 00000100:00100000:1.0:1783141887.993185:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492754944 00000100:00100000:1.0:1783141887.993253:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:1.0:1783141887.993264:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b1eea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+21:12280:x1869759492754944:12345-192.168.203.27@tcp:35:umount.0 00000100:00100000:1.0:1783141887.994728:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b1eea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:12280:x1869759492754944:12345-192.168.203.27@tcp:35:umount.0 Request processed in 1455us (1786us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1783141887.994744:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 68 00000100:00100000:3.0:1783141887.998971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141887.999093:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492755200 00000100:00100000:2.0:1783141887.999107:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492755200 00000100:00100000:2.0:1783141887.999192:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:2.0:1783141887.999203:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+22:12280:x1869759492755200:12345-192.168.203.27@tcp:35:umount.0 00000100:00100000:2.0:1783141888.000007:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:12280:x1869759492755200:12345-192.168.203.27@tcp:35:umount.0 Request processed in 799us (1044us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783141888.000018:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 69 00000100:00100000:0.0:1783141888.004841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141888.004888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141888.004998:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492755456 00000100:00100000:1.0:1783141888.005012:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492755456 00000100:00100000:1.0:1783141888.005097:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492755328 00000100:00100000:1.0:1783141888.005101:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492755328 00000100:00100000:1.0:1783141888.005145:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:1.0:1783141888.005157:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+14:2367:x1869759492755456:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141888.005178:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141888.005202:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946480030a00/0x279ffa91da89866a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcb2 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.005223:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141888.005287:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+13:2367:x1869759492755456:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 132us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141888.005296:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:1.0:1783141888.005316:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:1.0:1783141888.005453:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:2367:x1869759492755328:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141888.005508:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141888.005518:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a6400/0x279ffa91da8986a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcea expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.005529:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141888.005860:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:2367:x1869759492755328:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 536us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141888.005885:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:3.0:1783141888.009963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141888.010476:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492755584 00000100:00100000:2.0:1783141888.010490:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492755584 00000100:00100000:2.0:1783141888.010579:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:2.0:1783141888.010661:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+11:2366:x1869759492755584:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141888.010685:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141888.010709:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2174200/0x279ffa91da898918 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdb5 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141888.010734:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141888.010813:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2366:x1869759492755584:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 223us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141888.010821:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:3.0:1783141888.014924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141888.014995:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492755968 00000100:00100000:1.0:1783141888.015007:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492755968 00000100:00100000:1.0:1783141888.015095:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:1.0:1783141888.015106:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+7:2365:x1869759492755968:12345-192.168.203.27@tcp:9:umount.0 00000020:00000080:1.0:1783141888.015157:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898c3d 00000020:00010000:1.0:1783141888.015165:0:6586:0:(genops.c:1942:obd_stale_export_put()) Put export ffff946489852800: total 0 00000100:00080000:1.0:1783141888.015170:0:6586:0:(import.c:65:import_set_state_nolock()) ffff946489850800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783141888.015223:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:2.0:1783141888.015619:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:3.0:1783141888.015820:0:5775:0:(genops.c:1928:obd_stale_export_get()) Get export ffff946489852800: total 0 00010000:00010000:3.0:1783141888.015854:0:5775:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff946489852800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783141888.015920:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004315efb2/0x279ffa91da89967e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0158 expref: 5 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141888.015954:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000810aad06/0x279ffa91da898fe0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff8a expref: 4 pid: 10144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141888.015971:0:5775:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff946489852800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1783141888.015980:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141888.015982:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141888.015983:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141888.016032:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+2:2365:x1869759492755968:12345-192.168.203.27@tcp:9:umount.0 Request processed in 926us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141888.016042:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 72 00000100:00100000:1.0:1783141888.024531:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141888.025255:0:10144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492756096 00000100:00100000:3.0:1783141888.025268:0:10144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492756096 00000100:00100000:3.0:1783141888.025361:0:10144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:3.0:1783141888.025373:0:10144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+5:2365:x1869759492756096:12345-192.168.203.27@tcp:9:umount.0 00000020:00000080:3.0:1783141888.025416:0:10144:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8989dc 00000100:00080000:3.0:1783141888.025428:0:10144:0:(import.c:65:import_set_state_nolock()) ffff9464874de000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141888.025506:0:10144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1783141888.025547:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141888.025890:0:10144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+2:2365:x1869759492756096:12345-192.168.203.27@tcp:9:umount.0 Request processed in 517us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141888.025898:0:10144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 73 00000100:00100000:1.0:1783141888.026657:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510558592:0@lo:400:kworker.0 00000100:00100000:1.0:1783141888.026736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141888.026795:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510559104:0@lo:400:kworker.0 00000100:00100000:1.0:1783141888.026823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141888.026852:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141888.026858:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510558720:0@lo:400:kworker.0 00000100:00100000:1.0:1783141888.026880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141888.026913:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510559104 00000100:00100000:1.0:1783141888.026920:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510559104 00000100:00100000:1.0:1783141888.026963:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783141888.026972:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510559104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141888.027035:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510559104:12345-0@lo:400:kworker.0 Request processed in 63us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141888.027059:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783141888.027107:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510559104:0@lo:400:kworker.0 00000100:00100000:0.0:1783141888.027480:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510558592 00000100:00100000:0.0:1783141888.027487:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510558592 00000100:00100000:0.0:1783141888.027678:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510558720 00000100:00100000:0.0:1783141888.027682:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510558720 00000100:00100000:0.0:1783141888.027714:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783141888.027723:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510558592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141888.027787:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510558592:12345-0@lo:400:kworker.0 Request processed in 65us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141888.027794:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783141888.027809:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783141888.027815:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510558720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141888.027844:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510558720:12345-0@lo:400:kworker.0 Request processed in 29us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141888.027851:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783141888.027923:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba71dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510559232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141888.027958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141888.028003:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510559232 00000100:00100000:0.0:1783141888.028007:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510559232 00000100:00100000:0.0:1783141888.028034:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783141888.028041:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510559232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141888.028074:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141888.028110:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510559232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141888.028129:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783141888.028190:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba71dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510559232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141888.028448:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510558720:0@lo:400:kworker.0 00000100:00100000:0.0:1783141888.028484:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510558592:0@lo:400:kworker.0 00000100:00100000:3.0:1783141888.029335:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510558464:0@lo:400:kworker.0 00000100:00100000:0.0:1783141888.029379:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510558848:0@lo:400:kworker.0 00000100:00100000:3.0:1783141888.029409:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141888.029427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141888.029514:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510558464 00000100:00100000:1.0:1783141888.029522:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510558464 00000100:00100000:1.0:1783141888.029568:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1783141888.029576:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510558464:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783141888.029600:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783141888.029606:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141888.029609:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141888.029638:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510558848 00000100:00100000:1.0:1783141888.029639:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+19:3308:x1869759510558464:12345-0@lo:400:kworker.0 Request processed in 63us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141888.029642:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510558848 00000100:00100000:1.0:1783141888.029647:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783141888.029671:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783141888.029679:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510558848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141888.029717:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510558848:12345-0@lo:400:kworker.0 Request processed in 40us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141888.029724:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783141888.029943:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510558464:0@lo:400:kworker.0 00000100:00100000:3.0:1783141888.029952:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510558976:0@lo:400:kworker.0 00000100:00100000:3.0:1783141888.029982:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141888.030168:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510558976 00000100:00100000:1.0:1783141888.030173:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510558976 00000100:00100000:1.0:1783141888.030228:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783141888.030238:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510558976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141888.030276:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510558976:12345-0@lo:400:kworker.0 Request processed in 41us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141888.030283:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1783141888.030405:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141888.033437:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510558848:0@lo:400:kworker.0 00000100:00100000:3.0:1783141888.036921:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510558976:0@lo:400:kworker.0 00000100:00100000:2.0:1783141888.042633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141888.042767:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492757120 00000100:00100000:0.0:1783141888.042783:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492757120 00000100:00100000:0.0:1783141888.042862:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 240 00000100:00100000:0.0:1783141888.042873:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+23:2365:x1869759492757120:12345-192.168.203.27@tcp:39:umount.0 00000020:00000080:0.0:1783141888.042919:0:5788:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898678 00000020:00010000:0.0:1783141888.042939:0:5788:0:(genops.c:1942:obd_stale_export_put()) Put export ffff94649726f800: total 0 00000100:00080000:0.0:1783141888.042944:0:5788:0:(import.c:65:import_set_state_nolock()) ffff946497293000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783141888.042985:0:5788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1783141888.043145:0:5776:0:(genops.c:1928:obd_stale_export_get()) Get export ffff94649726f800: total 0 00010000:00010000:1.0:1783141888.043200:0:5776:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff94649726f800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1783141888.043310:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:1.0:1783141888.043315:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783141888.043323:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042a00/0x279ffa91da898c9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99feb1 expref: 23 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.043350:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94648a1ad000) 00010000:00010000:1.0:1783141888.043353:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141888.043358:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da898942 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdc3 expref: 23 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.043402:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141888.043405:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783141888.043409:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2042600/0x279ffa91da898fcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff83 expref: 20 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.043421:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:1.0:1783141888.043423:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783141888.043427:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0e00/0x279ffa91da89933d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a007f expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.043440:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141888.043442:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783141888.043445:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899669 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0151 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141888.043502:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c7e4ac0-9090-4366-bd86-d237f38a8cf1+17:2365:x1869759492757120:12345-192.168.203.27@tcp:39:umount.0 Request processed in 629us (881us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1783141888.043512:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 240 00010000:00010000:1.0:1783141888.046906:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141888.046922:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783141888.046945:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1200/0x279ffa91da89955f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a010b expref: 16 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.046995:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141888.046998:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783141888.047002:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52400/0x279ffa91da89964d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a014a expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.047018:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94648c722b00) 00010000:00010000:1.0:1783141888.047021:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783141888.047291:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1600/0x279ffa91da89905e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffad expref: 14 pid: 10143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.047319:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141888.047322:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783141888.047326:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a7a00/0x279ffa91da898ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff3d expref: 13 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.047341:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94648c722c00) 00010000:00010000:1.0:1783141888.047344:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783141888.047348:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a0600/0x279ffa91da8989b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fddf expref: 12 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.047366:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff946489eedc00) 00010000:00010000:1.0:1783141888.047369:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141888.047373:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464814a6200/0x279ffa91da89895e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdca expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.047392:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff946489eed100) 00010000:00010000:1.0:1783141888.047396:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141888.047400:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da89963f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0143 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.047415:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722d00) 00010000:00010000:1.0:1783141888.047418:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141888.047423:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1400/0x279ffa91da899042 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ffa6 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.047436:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94648c722900) 00010000:00010000:1.0:1783141888.047446:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141888.047450:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f53200/0x279ffa91da898fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99ff75 expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141888.047492:0:5776:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff94649726f800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1783141888.048273:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141888.048279:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141888.048282:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141888.216900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141888.217072:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492757248 00000100:00100000:3.0:1783141888.217085:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492757248 00000100:00100000:3.0:1783141888.217189:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 161 00000100:00100000:3.0:1783141888.217202:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2368:x1869759492757248:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141888.217309:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2368:x1869759492757248:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 109us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141888.217318:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 161 00000100:00080000:2.0:1783141888.218454:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141888.538925:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510559360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783141888.539021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141888.539199:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510559360 00000100:00100000:2.0:1783141888.539209:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510559360 00000100:00100000:2.0:1783141888.539275:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783141888.539286:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510559360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783141888.539332:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141888.539391:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510559360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141888.539399:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783141888.539549:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510559360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783141888.730772:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141889.754729:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141889.858673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141889.858722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141889.858764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141889.858802:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492757376 00000100:00100000:1.0:1783141889.858816:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492757376 00000100:00100000:0.0:1783141889.858857:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492757632 00000100:00100000:0.0:1783141889.858862:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492757632 00000100:00100000:1.0:1783141889.858946:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492757504 00000100:00100000:1.0:1783141889.858950:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492757504 00000100:00100000:0.0:1783141889.859260:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:0.0:1783141889.859274:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:2369:x1869759492757376:12345-192.168.203.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783141889.859297:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:3.0:1783141889.859306:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+12:2369:x1869759492757632:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141889.859314:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141889.859314:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141889.859336:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2175000/0x279ffa91da8988f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fdae expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141889.859336:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a1a00/0x279ffa91da89874a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcff expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141889.859356:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141889.859356:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141889.859407:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:1.0:1783141889.859416:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+10:2369:x1869759492757504:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141889.859425:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141889.859434:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94649d0d6000/0x279ffa91da898751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fd29 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141889.859444:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141889.859571:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+9:2369:x1869759492757632:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 265us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141889.859580:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:0.0:1783141889.863060:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:2369:x1869759492757376:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 3772us (4385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141889.863096:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+8:2369:x1869759492757504:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 3679us (4329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141889.863114:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:0.0:1783141889.865326:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:0.0:1783141889.866709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141889.866997:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492757888 00000100:00100000:3.0:1783141889.867010:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492757888 00000100:00100000:3.0:1783141889.867089:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 241 00000100:00100000:3.0:1783141889.867101:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+6:2365:x1869759492757888:12345-192.168.203.27@tcp:39:umount.0 00000020:00000080:3.0:1783141889.867185:0:5786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da89875f 00000020:00010000:3.0:1783141889.867206:0:5786:0:(genops.c:1942:obd_stale_export_put()) Put export ffff946489d48000: total 0 00000100:00080000:3.0:1783141889.867211:0:5786:0:(import.c:65:import_set_state_nolock()) ffff946489d4b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783141889.867246:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1783141889.867539:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20702fa5-92e9-446c-b215-c14c139e5a0c+5:2365:x1869759492757888:12345-192.168.203.27@tcp:39:umount.0 Request processed in 439us (838us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1783141889.867548:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 241 00000020:00010000:1.0:1783141889.867715:0:5776:0:(genops.c:1928:obd_stale_export_get()) Get export ffff946489d48000: total 0 00010000:00010000:1.0:1783141889.867720:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141889.867773:0:5776:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff946489d48000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783141889.867824:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648c722d00) 00010000:00010000:1.0:1783141889.867828:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141889.867840:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464b25a1800/0x279ffa91da89968c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a015f expref: 4 pid: 7171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141889.867867:0:5776:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff946489d48000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783141889.867878:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141889.867879:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141889.867881:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141889.903819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141889.903961:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492758144 00000100:00100000:1.0:1783141889.903974:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492758144 00000100:00100000:1.0:1783141889.904050:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 299 00000100:00100000:1.0:1783141889.904062:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+7:2365:x1869759492758144:12345-192.168.203.27@tcp:251:umount.0 00000020:00000080:1.0:1783141889.904132:0:5780:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898655 00000020:00010000:1.0:1783141889.904143:0:5780:0:(genops.c:1942:obd_stale_export_put()) Put export ffff946497290000: total 0 00000100:00080000:1.0:1783141889.904149:0:5780:0:(import.c:65:import_set_state_nolock()) ffff946497296800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783141889.904245:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e3383e0-4c8b-465d-82d6-c67e2deecb1d+3:2365:x1869759492758144:12345-192.168.203.27@tcp:251:umount.0 Request processed in 184us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141889.904254:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 299 00000020:00010000:3.0:1783141889.905032:0:5775:0:(genops.c:1928:obd_stale_export_get()) Get export ffff946497290000: total 0 00010000:00010000:3.0:1783141889.905094:0:5775:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff946497290000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783141889.905145:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a7400/0x279ffa91da8986a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e99fcf1 expref: 2 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141889.905164:0:5775:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff946497290000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1783141889.905174:0:5775:0:(genops.c:906:class_export_put()) final put ffff946497290000/1e3383e0-4c8b-465d-82d6-c67e2deecb1d 00010000:00010000:3.0:1783141889.905204:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141889.905207:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141889.905208:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783141889.905332:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff946497290000/1e3383e0-4c8b-465d-82d6-c67e2deecb1d for MGS 00000020:00000080:0.0:1783141889.905377:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946497296800 for MGS 00010000:00010000:1.0:1783141890.779660:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783141891.704354:0:12773:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783141891.721297:0:12773:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783141891.721368:0:12773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.721387:0:12773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.721395:0:12773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.721402:0:12773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.721428:0:12773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783141891.721435:0:12773:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783141891.721486:0:12773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783141891.721493:0:12773:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1783141891.721503:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141891.721517:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783141891.721519:0:12773:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1783141891.721535:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174000 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141891.721541:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.721552:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783141891.721557:0:12773:0:(import.c:65:import_set_state_nolock()) ffff9464850d9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:1.0:1783141891.721579:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141891.721587:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783141891.721591:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783141891.721595:0:5776:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783141891.721639:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.721647:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141891.721683:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.721691:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2174000/0x279ffa91da8986e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986ef expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.721707:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141891.721709:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141891.721712:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141891.721723:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141891.721742:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510559616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783141891.721807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141891.721872:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510559616 00000100:00100000:1.0:1783141891.721879:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510559616 00000100:00100000:1.0:1783141891.721930:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783141891.721938:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+19:3307:x1869759510559616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783141891.721951:0:6600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141891.721965:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a6e00/0x279ffa91da8986ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8986e8 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.721984:0:6600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141891.722015:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:872ec41a-f648-467b-b036-39669ac398c4+18:3307:x1869759510559616:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141891.722022:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783141891.722059:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:872ec41a-f648-467b-b036-39669ac398c4:3307:1869759510559616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141891.722149:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510559488:0@lo:39:umount.0 00000100:00100000:3.0:1783141891.722184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141891.722256:0:7171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510559488 00000100:00100000:1.0:1783141891.722261:0:7171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510559488 00000100:00100000:1.0:1783141891.722294:0:7171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783141891.722300:0:7171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1869759510559488:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783141891.722321:0:7171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898464 00000100:00080000:1.0:1783141891.722330:0:7171:0:(import.c:65:import_set_state_nolock()) ffff94649d167800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783141891.722386:0:7171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1869759510559488:12345-0@lo:39:umount.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141891.722392:0:7171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1783141891.722399:0:7171:0:(genops.c:906:class_export_put()) final put ffff946482f09800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1783141891.722420:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783141891.722428:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946482f09800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783141891.722498:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94649d167800 for lustre-MDT0000 00000100:00080000:1.0:1783141891.722522:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9464850d9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783141891.722531:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baacb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510559488:0@lo:39:umount.0 00000100:00080000:0.0:1783141891.723823:0:12773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783141891.723834:0:12773:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783141891.723842:0:12773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783141891.727357:0:12773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727375:0:12773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727403:0:12773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727410:0:12773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727441:0:12773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141891.727447:0:12773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727454:0:12773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727484:0:12773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727490:0:12773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727505:0:12773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783141891.727512:0:12773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727519:0:12773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727526:0:12773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727543:0:12773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727557:0:12773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783141891.727563:0:12773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727569:0:12773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727574:0:12773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727579:0:12773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141891.727585:0:12773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1783141891.727588:0:12773:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1783141891.727609:0:12773:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1783141891.727614:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1783141891.727618:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141891.727622:0:12773:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1783141891.727630:0:12773:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff946497292000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141891.727635:0:12773:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff946496824000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141891.727641:0:12773:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff946489d48000 20702fa5-92e9-446c-b215-c14c139e5a0c 192.168.203.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141891.727646:0:12773:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff94649726f800 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 192.168.203.27@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1783141891.727650:0:12773:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9464bab399c0) has exports, disconnecting them 00000020:00080000:1.0:1783141891.727659:0:12773:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff946497292000), last request at 1783141888 00000020:00000080:1.0:1783141891.727666:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8985d7 00000100:00080000:1.0:1783141891.727685:0:12773:0:(import.c:65:import_set_state_nolock()) ffff946497294000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783141891.727725:0:12773:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff946497292000): rc 0 00000020:00000080:1.0:1783141891.727728:0:12773:0:(genops.c:906:class_export_put()) final put ffff946497292000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1783141891.727739:0:12773:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff946496824000), last request at 1783141888 00000020:00000080:1.0:1783141891.727742:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8984fe 00000100:00080000:1.0:1783141891.727749:0:12773:0:(import.c:65:import_set_state_nolock()) ffff946496822000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783141891.727756:0:12773:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff946496824000): rc 0 00000020:00000080:1.0:1783141891.727757:0:12773:0:(genops.c:906:class_export_put()) final put ffff946496824000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1783141891.727764:0:12773:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa4c301823ae0 00000100:00080000:1.0:1783141891.727783:0:12773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783141891.727787:0:12773:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1783141891.727802:0:12773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783141891.727869:0:12773:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783141891.727893:0:12773:0:(import.c:65:import_set_state_nolock()) ffff9464bfee7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783141891.727908:0:12773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783141891.727910:0:12773:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1783141891.727917:0:12773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783141891.727982:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510559744:0@lo:9:umount.0 00000100:00100000:1.0:1783141891.728039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141891.728087:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510559744 00000100:00100000:1.0:1783141891.728093:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510559744 00000100:00100000:1.0:1783141891.728158:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783141891.728167:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1869759510559744:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783141891.728188:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da89854b 00000100:00080000:1.0:1783141891.728193:0:6586:0:(import.c:65:import_set_state_nolock()) ffff946381366000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783141891.728212:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1783141891.728373:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1869759510559744:12345-0@lo:9:umount.0 Request processed in 206us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141891.728380:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1783141891.728419:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9464bfee7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783141891.728426:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783141891.728428:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783141891.728431:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510559744:0@lo:9:umount.0 00000100:00080000:1.0:1783141891.728450:0:12773:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783141891.728481:0:12773:0:(import.c:65:import_set_state_nolock()) ffff946381370800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783141891.728496:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510559872:0@lo:9:umount.0 00000100:00100000:1.0:1783141891.728519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783141891.728560:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9464bab399c0) has no exports 00010000:00010000:3.0:1783141891.728638:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783141891.728648:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728656:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7c00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:3.0:1783141891.728660:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728679:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141891.728687:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141891.728693:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783141891.728696:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1783141891.728700:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1783141891.728726:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728732:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141891.728760:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.728765:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783141891.728767:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff94649d0d7c00/0x279ffa91da8986f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986fd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.728781:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728787:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783141891.728800:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.728801:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946480030c00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141891.728809:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728816:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:3.0:1783141891.728824:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.728830:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728836:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141891.728843:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141891.728858:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783141891.728868:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:00010000:3.0:1783141891.728877:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141891.728884:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783141891.728885:0:5776:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:3.0:1783141891.728888:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783141891.728892:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783141891.728922:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728928:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141891.728931:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728939:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.728941:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141891.728952:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946496f52800/0x279ffa91da89890a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da898911 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728968:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141891.728975:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.728976:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.729005:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946480030c00/0x279ffa91da89860f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da898616 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.729008:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175c00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:3.0:1783141891.729015:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.729024:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141891.729034:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141891.729059:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783141891.729060:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783141891.729063:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783141891.729065:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1783141891.729068:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783141891.729070:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1783141891.729080:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783141891.729091:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.729098:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783141891.729102:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510560256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141891.729123:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.729133:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2175c00/0x279ffa91da8983c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8983ca expref: -99 pid: 5768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.729151:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141891.729154:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141891.729158:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141891.729176:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510560128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141891.729180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141891.729242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141891.729257:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510560384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141891.729278:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141891.729292:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510560000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141891.729299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141891.729328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141891.729379:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510560256 00000100:00100000:3.0:1783141891.729384:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510560256 00000100:00100000:3.0:1783141891.729418:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510560128 00000100:00100000:3.0:1783141891.729421:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510560128 00000100:00100000:3.0:1783141891.729432:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510560384 00000100:00100000:3.0:1783141891.729435:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510560384 00000100:00100000:3.0:1783141891.729446:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510560000 00000100:00100000:3.0:1783141891.729448:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510560000 00000100:00100000:3.0:1783141891.729504:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141891.729510:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+21:3308:x1869759510560256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141891.729520:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141891.729533:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a7200/0x279ffa91da898616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da89860f expref: 21 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.729551:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141891.729583:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+20:3308:x1869759510560256:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141891.729590:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783141891.729604:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783141891.729609:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+19:3306:x1869759510560128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141891.729616:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783141891.729625:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1783141891.729627:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946496f53a00/0x279ffa91da898911 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da89890a expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.729641:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141891.729645:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b25bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:872ec41a-f648-467b-b036-39669ac398c4+18:3308:x1869759510560384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141891.729663:0:7493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783141891.729674:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+18:3306:x1869759510560128:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (438us total) trans 0 rc 0/0 00010000:00010000:0.0:1783141891.729681:0:7493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2043c00/0x279ffa91da8983ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8983c3 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141891.729683:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783141891.729710:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1783141891.729714:0:7493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141891.729722:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+16:3306:x1869759510560000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141891.729734:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141891.729746:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a1000/0x279ffa91da8986fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8986f6 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141891.729762:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141891.729765:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b25bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:872ec41a-f648-467b-b036-39669ac398c4+15:3308:x1869759510560384:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141891.729776:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783141891.729823:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:872ec41a-f648-467b-b036-39669ac398c4+14:3306:x1869759510560000:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141891.729831:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783141891.729882:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510560000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141891.729890:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:872ec41a-f648-467b-b036-39669ac398c4:3306:1869759510560128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141891.729914:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510560384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141891.729922:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510560256:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141891.732329:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783141891.732343:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff946497292000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783141891.732405:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff946496824000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783141891.732431:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946497294000 for lustre-MDT0000 00000020:00000080:2.0:1783141891.732451:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946496822000 for lustre-MDT0000 00000100:00100000:2.0:1783141891.733817:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510559872 00000100:00100000:2.0:1783141891.733828:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510559872 00000100:00100000:2.0:1783141891.733889:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783141891.733898:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1869759510559872:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783141891.733927:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898640 00000100:00080000:2.0:1783141891.733936:0:6584:0:(import.c:65:import_set_state_nolock()) ffff946497225000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783141891.734017:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1783141891.734230:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1869759510559872:12345-0@lo:9:umount.0 Request processed in 333us (5710us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141891.734237:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1783141891.734341:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946381370800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783141891.734355:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783141891.734357:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783141891.734361:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510559872:0@lo:9:umount.0 00000100:00080000:2.0:1783141891.734400:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141891.734405:0:5783:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783141891.734896:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783141891.745734:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9464bab399c0) has no exports 00000020:00000080:1.0:1783141891.772639:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da89841e 00000020:00000080:1.0:1783141891.772655:0:12773:0:(genops.c:906:class_export_put()) final put ffff946489ce5000/lustre-QMT0000_UUID 00000020:01000000:1.0:1783141891.772723:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783141891.772733:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141891.772741:0:12773:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783141891.772745:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff946482f2cd40) has no exports 00000020:00000080:1.0:1783141891.772985:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898417 00000020:00000080:1.0:1783141891.772993:0:12773:0:(genops.c:906:class_export_put()) final put ffff946489ce3000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783141891.773026:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946489ce5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783141891.773077:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946489ce3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783141891.773139:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141891.773148:0:12773:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783141891.773151:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464ba10e800/lustre-QMT0000_UUID 00000020:00000080:1.0:1783141891.773154:0:12773:0:(genops.c:865:class_export_destroy()) destroying export ffff9464ba10e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783141891.773162:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1783141891.803158:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783141892.171283:0:5809:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000001:00080000:1.0:1783141892.171298:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1783141892.171329:0:5809:0:(genops.c:906:class_export_put()) final put ffff94649726f800/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000001:00100000:1.0:1783141892.171346:0:5809:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 20702fa5-92e9-446c-b215-c14c139e5a0c 00000001:00080000:1.0:1783141892.171352:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1783141892.171354:0:5809:0:(genops.c:906:class_export_put()) final put ffff946489d48000/20702fa5-92e9-446c-b215-c14c139e5a0c 00000020:00000080:2.0:1783141892.175613:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff94649726f800/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 for lustre-MDT0000 00000020:00000080:2.0:1783141892.175684:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff946489d48000/20702fa5-92e9-446c-b215-c14c139e5a0c for lustre-MDT0000 00000020:00000080:2.0:1783141892.175707:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946497293000 for lustre-MDT0000 00000020:00000080:2.0:1783141892.175712:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946489d4b800 for lustre-MDT0000 00000001:00100000:0.0:1783141892.191130:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000020:00000080:0.0:1783141892.191138:0:7506:0:(genops.c:906:class_export_put()) final put ffff946489852800/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000001:00100000:0.0:1783141892.191166:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783141892.191168:0:7506:0:(genops.c:906:class_export_put()) final put ffff946497222800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783141892.191224:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946489852800/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 for lustre-OST0001 00000020:00000080:2.0:1783141892.191270:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946497222800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783141892.191284:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946489850800 for lustre-OST0001 00000020:00000080:2.0:1783141892.191289:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946497225000 for lustre-OST0001 00000001:00100000:0.0:1783141892.703665:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783141892.703686:0:6610:0:(genops.c:906:class_export_put()) final put ffff946381363800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783141892.703718:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000020:00000080:0.0:1783141892.703720:0:6610:0:(genops.c:906:class_export_put()) final put ffff9464874db000/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 00000020:00000080:2.0:1783141892.703819:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff946381363800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783141892.703866:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9464874db000/8c7e4ac0-9090-4366-bd86-d237f38a8cf1 for lustre-OST0000 00000020:00000080:2.0:1783141892.703882:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946381366000 for lustre-OST0000 00000020:00000080:2.0:1783141892.703894:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9464874de000 for lustre-OST0000 00010000:00010000:2.0:1783141892.828409:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141893.149449:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baacb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510560640:0@lo:400:kworker.0 00000100:00100000:2.0:1783141893.149487:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510560768:0@lo:400:kworker.0 00000100:00100000:1.0:1783141893.149572:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510560512:0@lo:400:kworker.0 00000100:00100000:2.0:1783141893.150144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141893.150579:0:10143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510560768 00000100:00100000:0.0:1783141893.150588:0:10143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510560768 00000100:00100000:0.0:1783141893.150636:0:10143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783141893.150644:0:10143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1869759510560768:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783141893.150652:0:10143:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783141893.150703:0:10143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1869759510560768:12345-0@lo:400:kworker.0 Request processed in 58us (560us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783141893.150710:0:10143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1783141893.150743:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783141893.150748:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9464b9d65800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783141893.150752:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1783141893.159788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141893.159965:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510560640 00000100:00100000:3.0:1783141893.159975:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510560640 00000100:00100000:3.0:1783141893.160025:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783141893.160033:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1869759510560640:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783141893.160043:0:5788:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783141893.160112:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1869759510560640:12345-0@lo:400:kworker.0 Request processed in 78us (331us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783141893.160119:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1783141893.160212:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783141893.160218:0:3306:0:(import.c:65:import_set_state_nolock()) ffff946381372000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783141893.160222:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783141893.160227:0:3306:0:(import.c:65:import_set_state_nolock()) ffff946381372000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141893.160231:0:3306:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 204 00000100:00080000:2.0:1783141893.160238:0:3306:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff946381372000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141893.160268:0:3306:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496b24380 x1869759510560896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783141893.160298:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baacb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1869759510560640:0@lo:400:kworker.0 00000100:00100000:3.0:1783141893.160537:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1869759510560896:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783141893.160574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141893.163783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141893.164154:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510560512 00000100:00100000:3.0:1783141893.164164:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510560512 00000100:00100000:3.0:1783141893.164255:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1783141893.164265:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:3305:x1869759510560512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141893.164352:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464869b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:872ec41a-f648-467b-b036-39669ac398c4+14:3305:x1869759510560512:12345-0@lo:400:kworker.0 Request processed in 89us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141893.164372:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1783141893.164788:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510560512:0@lo:400:kworker.0 00000100:00100000:2.0:1783141893.168078:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510560896 00000100:00100000:2.0:1783141893.168101:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510560896 00000100:00100000:2.0:1783141893.168165:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1783141893.168174:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1869759510560896:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1783141893.168192:0:5787:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783141893.170085:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9464b9d65800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783141893.170104:0:3307:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 221 00000100:00080000:0.0:1783141893.170113:0:3307:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9464b9d65800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1783141893.170743:0:3307:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464baac9c00 x1869759510561024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141893.170852:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510560768:0@lo:400:kworker.0 00000100:00100000:3.0:1783141893.171882:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1869759510561024:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783141893.172104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141893.172277:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510561024 00000100:00100000:0.0:1783141893.172286:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510561024 00000100:00100000:0.0:1783141893.172327:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783141893.172334:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1869759510561024:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1783141893.172351:0:5786:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783141893.172407:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1869759510561024:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 71us (312us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783141893.172432:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1783141893.172483:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9464b9d65800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783141893.172489:0:3304:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783141893.172494:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1869759510561024:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783141893.190907:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1869759510560896:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 22723us (30322us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783141893.190921:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1783141893.191091:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946381372000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783141893.191110:0:3304:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783141893.191114:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1869759510560896:0@lo:38:ptlrpcd_00_01.0 00000020:01000000:1.0:1783141893.786591:0:12773:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94638196df60 - data ffff946497787d80/ffff946497457400 00000020:01000000:1.0:1783141893.786752:0:12773:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94648c1a4180 - data ffff9464a77db5e8/ffff9464b9dc2800 00000001:00000004:1.0:1783141893.793248:0:12773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1783141893.851136:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783141893.860757:0:12773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783141893.860765:0:12773:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1783141893.860784:0:12773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783141893.860787:0:12773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783141893.863698:0:6631:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783141893.863707:0:6631:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1783141893.863719:0:6631:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783141893.864560:0:12773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783141893.864573:0:12773:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1783141893.864588:0:12773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783141893.864591:0:12773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783141893.865718:0:7955:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783141893.865724:0:7955:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1783141893.865734:0:7955:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783141893.923173:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8983e6 00000020:00000080:1.0:1783141893.923184:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464bab41800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783141893.924086:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8983fb 00000020:00000080:1.0:1783141893.924102:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464bab53800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783141893.924109:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783141893.924114:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141893.924121:0:12773:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783141893.924125:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9464bab3b380) has no exports 00000004:01000000:1.0:1783141893.924269:0:12773:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783141893.924278:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898639 00000020:00000080:1.0:1783141893.924282:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464bb128000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783141893.924285:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783141893.924300:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141893.924307:0:12773:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783141893.924309:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9464bfed4d40) has no exports 00000020:00000080:1.0:1783141893.924314:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898632 00000020:00000080:1.0:1783141893.924317:0:12773:0:(genops.c:906:class_export_put()) final put ffff946381377000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1783141893.924848:0:12773:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783141893.924853:0:12773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783141893.924857:0:12773:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1783141893.924862:0:12773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783141893.924864:0:12773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783141893.924892:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141893.924899:0:12773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141893.924904:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898544 00000020:00000080:1.0:1783141893.924909:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464bfee0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783141893.924912:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783141893.924916:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141893.924919:0:12773:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783141893.924921:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9464bfed19c0) has no exports 00000020:00000080:1.0:1783141893.924924:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da89853d 00000020:00000080:1.0:1783141893.924927:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464bfee3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783141893.925102:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bab41800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783141893.925116:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bab53800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1783141893.925120:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bb128000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783141893.925126:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946381377000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783141893.925130:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946381370800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783141893.925134:0:8:0:(genops.c:906:class_export_put()) final put ffff946381362000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783141893.925136:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946381362000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783141893.925140:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783141893.925205:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bfee0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783141893.925209:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bfee3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783141893.925680:0:12773:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783141893.925685:0:12773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783141893.925687:0:12773:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1783141893.925692:0:12773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783141893.925694:0:12773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783141893.925826:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141893.925834:0:12773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141893.925860:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141893.925863:0:12773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141893.925866:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464bab47000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783141893.925869:0:12773:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bab47000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783141893.925877:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783141893.926026:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898402 00000020:00000080:1.0:1783141893.926032:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464bab50800/lustre-MDD0000_UUID 00000020:00000080:2.0:1783141893.926453:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9464bfee7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783141893.926504:0:8:0:(genops.c:906:class_export_put()) final put ffff946381371000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783141893.926508:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946381371000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783141893.926512:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783141893.926708:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783141893.926776:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141893.926782:0:12773:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783141893.926786:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9464bab3cd40) has no exports 00000020:00000080:1.0:1783141893.926807:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141893.926811:0:12773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783141893.926816:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898409 00000020:00000080:1.0:1783141893.926821:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464bab54800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783141893.926828:0:12773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946489ce7800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783141893.926831:0:12773:0:(obd_mount.c:701:lustre_put_lsi()) put ffff946489ce7800 3 00000020:01000004:1.0:1783141893.926834:0:12773:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946489ce7800 from lustre-MDT0000 00000020:00000080:1.0:1783141893.926850:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141893.926853:0:12773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783141893.926855:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464bab45800/lustre-MDT0000_UUID 00000020:00000080:1.0:1783141893.926857:0:12773:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bab45800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783141893.926863:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783141893.926890:0:12773:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1783141893.926893:0:12773:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783141893.926896:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783141893.926898:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141893.926901:0:12773:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783141893.926907:0:12773:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9464830b8000 872ec41a-f648-467b-b036-39669ac398c4 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141893.926913:0:12773:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff946493cc0000) has exports, disconnecting them 00000020:00080000:1.0:1783141893.926917:0:12773:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9464830b8000), last request at 1783141682 00000020:00000080:1.0:1783141893.926929:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8983a7 00000020:00010000:1.0:1783141893.926932:0:12773:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9464830b8000: total 2 00000100:00080000:1.0:1783141893.926936:0:12773:0:(import.c:65:import_set_state_nolock()) ffff9464830ba000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783141893.926953:0:12773:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9464830b8000): rc 0 00000020:00080000:1.0:1783141893.926957:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff946493cc0000) has no exports 00000100:00100000:1.0:1783141893.927008:0:5780:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff94648302f600:5780] 1 exiting: rc = 0 00000020:00010000:3.0:1783141893.927164:0:5775:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9464830b8000: total 2 00010000:00010000:3.0:1783141893.927193:0:5775:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9464830b8000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1783141893.927218:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0400/0x279ffa91da89870b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da898704 expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141893.927234:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2175400/0x279ffa91da898903 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8988fc expref: 8 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141893.927244:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0000/0x279ffa91da8986b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8986b0 expref: 7 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141893.927254:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94649d0d6200/0x279ffa91da8986e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8986da expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141893.927265:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464814a6a00/0x279ffa91da8986c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8986be expref: 5 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141893.927273:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0c00/0x279ffa91da8986d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8986cc expref: 4 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141893.927299:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2175e00/0x279ffa91da8984b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8984aa expref: 3 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141893.927310:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0a00/0x279ffa91da8988ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x279ffa91da8988e7 expref: 2 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141893.927320:0:5775:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9464830b8000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1783141893.927344:0:5775:0:(genops.c:906:class_export_put()) final put ffff9464830b8000/872ec41a-f648-467b-b036-39669ac398c4 00010000:00010000:3.0:1783141893.927350:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141893.927352:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141893.927353:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141893.927378:0:5782:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff946482ec1600:5782] 2 exiting: rc = 0 00000100:00100000:2.0:1783141893.928123:0:5779:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff946482ec0000:5779] 0 exiting: rc = 1 00000020:00000080:2.0:1783141893.928176:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bab50800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783141893.928182:0:8:0:(genops.c:906:class_export_put()) final put ffff9464bab46800/lustre-MDD0000_UUID 00000020:00000080:2.0:1783141893.928184:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bab46800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783141893.928190:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783141893.928441:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bab54800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783141893.928446:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464830b8000/872ec41a-f648-467b-b036-39669ac398c4 for MGS 00000100:00100000:1.0:1783141893.928582:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928589:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928595:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928600:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928606:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928612:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928617:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928623:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928629:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928646:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928652:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928657:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928663:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928668:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928674:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928680:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928685:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928692:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928699:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.928706:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929065:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929072:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929076:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929084:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929098:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929104:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929109:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929114:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929120:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929125:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929130:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929135:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929140:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929146:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929151:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929168:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929173:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929179:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929184:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929190:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929195:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929200:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929225:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929230:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929236:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929241:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929246:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929252:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929257:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929262:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929268:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929273:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929279:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929284:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929289:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929294:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929299:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929303:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929309:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929314:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929319:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929324:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929340:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.929346:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1783141893.929911:0:12773:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783141893.929915:0:12773:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:2.0:1783141893.930945:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9464830ba000 for MGS 00000020:01000000:1.0:1783141893.931512:0:12773:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94638196d840 - data ffff9464976005e8/ffff946497456c00 00000020:01000000:1.0:1783141893.931803:0:12773:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9464868a4420 - data ffff9464a7765000/ffff946482f27400 00000020:00000080:1.0:1783141893.932264:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da89838b 00000020:00000080:1.0:1783141893.932272:0:12773:0:(genops.c:906:class_export_put()) final put ffff946482b49800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783141893.932442:0:12773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946489ce7800 from MGS, refs=2 00000020:01000004:1.0:1783141893.932446:0:12773:0:(obd_mount.c:701:lustre_put_lsi()) put ffff946489ce7800 2 00000020:01000004:1.0:1783141893.932450:0:12773:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946489ce7800 from MGS 00000020:00000080:1.0:1783141893.932495:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141893.932502:0:12773:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783141893.932505:0:12773:0:(genops.c:906:class_export_put()) final put ffff946489ce0000/MGS 00000020:00000080:1.0:1783141893.932508:0:12773:0:(genops.c:865:class_export_destroy()) destroying export ffff946489ce0000/MGS for MGS 00000020:01000000:1.0:1783141893.932515:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783141893.932560:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783141893.932564:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141893.932568:0:12773:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783141893.932574:0:12773:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9464850dc000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141893.932580:0:12773:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff946482f28000) has exports, disconnecting them 00000020:00080000:1.0:1783141893.932584:0:12773:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9464850dc000), last request at 1783141683 00000020:00000080:1.0:1783141893.932588:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898456 00000020:00080000:1.0:1783141893.932597:0:12773:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9464850dc000): rc 0 00000020:00000080:1.0:1783141893.932601:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464850dc000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783141893.932794:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946482b49800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783141893.934151:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464850dc000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783141893.937568:0:12773:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783141893.937578:0:12773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783141893.937582:0:12773:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783141893.937589:0:12773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783141893.937626:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9464850d9000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783141893.937748:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141893.937756:0:12773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1783141893.937760:0:12773:0:(genops.c:906:class_export_put()) final put ffff9464ba10a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783141893.937764:0:12773:0:(genops.c:865:class_export_destroy()) destroying export ffff9464ba10a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783141893.937771:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783141893.937836:0:12773:0:(obd_mount.c:701:lustre_put_lsi()) put ffff946489ce7800 1 00000020:00000080:2.0:1783141893.937841:0:12773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da89837d 00000020:00000080:2.0:1783141893.937846:0:12773:0:(genops.c:906:class_export_put()) final put ffff946489ce7000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1783141893.937854:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783141893.937865:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946489ce7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783141893.937873:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141893.937877:0:12773:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783141893.937880:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff946493cc4d40) has no exports 00000020:00000080:3.0:1783141893.953291:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783141893.953309:0:12773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783141893.953385:0:12773:0:(genops.c:906:class_export_put()) final put ffff946489ce0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783141893.953391:0:12773:0:(genops.c:865:class_export_destroy()) destroying export ffff946489ce0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783141893.953400:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783141893.953539:0:12773:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff946489ce6800 00000020:01000000:3.0:1783141893.953560:0:12773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783141893.953564:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783141893.953568:0:12773:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783141893.953571:0:12773:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff946493cc3380) has no exports 00000100:00100000:3.0:1783141893.953651:0:5788:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff946482f01a00:5788] 2 exiting: rc = 0 00000100:00100000:3.0:1783141893.955559:0:7171:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff946489026000:7171] 3 exiting: rc = 0 00000100:00100000:3.0:1783141893.955674:0:5787:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff946482f31000:5787] 1 exiting: rc = 0 00000100:00100000:0.0:1783141893.957256:0:5786:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff946489d1e800:5786] 0 exiting: rc = 1 00000100:00100000:3.0:1783141893.958567:0:10143:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9464972c5a00:10143] 4 exiting: rc = 0 00000100:00100000:3.0:1783141893.958678:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958687:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958694:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958719:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958726:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958734:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958742:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958752:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958762:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958768:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958775:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958780:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958785:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958791:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958796:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958802:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958807:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958812:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958817:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958822:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958828:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958832:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958838:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958842:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958847:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958851:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958856:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958861:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958866:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958870:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958875:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958880:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958884:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958889:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958893:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958897:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958902:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958906:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958920:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958925:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958930:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958935:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958940:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958946:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958951:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958957:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958962:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958969:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958975:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958981:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.958986:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959001:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959007:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959012:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959018:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959024:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959029:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959035:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959040:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959045:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959050:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959056:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959070:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.959076:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141893.966795:0:5789:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff946482f00c00:5789] 0 exiting: rc = 1 00000100:00100000:2.0:1783141893.967549:0:5790:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff946482f00000:5790] 1 exiting: rc = 0 00000100:00100000:3.0:1783141893.967841:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967850:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967856:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967861:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967868:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967873:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967880:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967886:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967892:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967909:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967914:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967920:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967927:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967932:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967937:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967942:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967947:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967952:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967957:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967962:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967967:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967972:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967977:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967982:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.967987:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968048:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968054:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968059:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968064:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968069:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968074:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968079:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968084:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968097:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968103:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968108:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968113:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968118:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968124:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968130:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968135:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968141:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968146:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968151:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968165:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968170:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968176:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968182:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968188:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968194:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968198:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968204:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968209:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968214:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968219:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968224:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968229:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968235:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968239:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968245:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968250:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968255:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968260:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.968265:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141893.969141:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff94648bc42400:5791] 0 exiting: rc = 1 00000100:00100000:0.0:1783141893.973764:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff946482ef9e00:5792] 1 exiting: rc = 0 00000100:00100000:3.0:1783141893.973895:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973905:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973914:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973921:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973931:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973939:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973945:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973951:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973956:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973962:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973979:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.973986:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974004:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974012:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974020:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974041:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974049:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974057:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974066:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974075:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974083:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974101:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974134:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974145:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974150:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974160:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974184:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974192:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974198:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974203:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974292:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974299:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974306:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974312:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974342:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974349:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974355:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974361:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974367:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974373:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974378:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974383:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974388:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974395:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974400:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974405:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974425:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974432:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974438:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974443:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974456:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974506:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974513:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974528:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974535:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974543:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974550:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974559:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974578:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974586:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974596:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974602:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974609:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783141893.974616:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141893.997432:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff946482ef9600:5794] 1 exiting: rc = 0 00000100:00100000:0.0:1783141893.997432:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff946482ef8400:5793] 0 exiting: rc = 1 00000100:00100000:1.0:1783141893.998175:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998187:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998192:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998198:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998204:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998211:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998218:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998224:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998294:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998302:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998310:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998316:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998377:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998387:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998396:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998406:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998421:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998431:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998438:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998930:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998936:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998941:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998946:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998951:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998956:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998961:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998967:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998971:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998975:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998980:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998985:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.998998:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999004:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999009:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999015:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999019:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999025:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999029:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999035:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999041:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999045:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999050:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999055:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999059:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999064:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999068:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999073:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999078:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999083:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999096:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999101:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999116:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999120:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999125:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999130:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999134:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999139:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999143:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999148:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999153:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999158:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999163:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999167:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141893.999171:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783141894.000686:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff946482ef9c00:5795] 0 exiting: rc = 1 00000100:00100000:1.0:1783141894.001550:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff946482ef8800:5796] 1 exiting: rc = 0 00000100:00100000:1.0:1783141894.001619:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001694:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001703:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001709:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001784:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001792:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001800:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001808:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001815:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001822:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001829:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001836:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001843:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001851:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001858:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001866:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001872:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001879:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001886:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001890:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001894:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001912:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001917:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001923:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001928:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001934:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001940:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001945:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001950:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001954:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001959:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001963:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001967:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001971:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001976:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001981:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.001985:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002001:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002006:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002011:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002016:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002020:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002025:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002029:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002034:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002039:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002044:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002048:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002053:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002057:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002062:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002067:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002071:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002075:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002080:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002084:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002110:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002117:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002124:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002132:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002141:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002147:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002155:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.002165:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.003966:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff946482ef9400:5797] 0 exiting: rc = 1 00000100:00100000:3.0:1783141894.004103:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff946482ef9a00:5798] 1 exiting: rc = 0 00000100:00100000:1.0:1783141894.004186:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004196:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004205:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004213:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004222:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004227:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004233:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004238:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004243:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004248:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004253:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004259:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004264:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004269:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004275:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004281:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004291:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004297:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004306:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004312:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004317:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004322:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004327:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004333:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004338:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004343:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004348:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004365:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004370:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004374:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004380:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.004385:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006650:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006662:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006667:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006672:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006677:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006682:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006686:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006691:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006696:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006700:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006705:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006710:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006715:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006719:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006724:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006728:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006736:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006741:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006746:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006751:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006755:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006760:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006765:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006769:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006774:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006778:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006783:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006787:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006791:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006796:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006813:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141894.006818:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.008711:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff946482f00e00:5800] 1 exiting: rc = 0 00000100:00100000:1.0:1783141894.009947:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff946482f01e00:5799] 0 exiting: rc = 1 00000100:00100000:3.0:1783141894.010889:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9464b9d09600:5801] 2 exiting: rc = 0 00000100:00100000:2.0:1783141894.010958:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.010970:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.010978:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.010984:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.010989:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.010994:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011015:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011021:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011039:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011047:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011055:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011076:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011085:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011101:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011108:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011125:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011133:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011141:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011148:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011155:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011162:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011169:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011176:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011183:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011191:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011199:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011218:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011226:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011233:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011247:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011257:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011265:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011270:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011275:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011291:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011314:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011320:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011326:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011332:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011338:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011344:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011357:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011362:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011368:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011374:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011379:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011385:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011390:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011396:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011401:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011407:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011413:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011419:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011437:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011444:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011450:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011455:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011975:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011984:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011990:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.011998:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.012006:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.012014:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141894.012103:0:12773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783141894.023568:0:12773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141894.023582:0:12773:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1783141894.023587:0:12773:0:(genops.c:906:class_export_put()) final put ffff946482f0d800/MDS_uuid 00000020:00000080:2.0:1783141894.023592:0:12773:0:(genops.c:865:class_export_destroy()) destroying export ffff946482f0d800/MDS_uuid for MDS 00000020:01000000:2.0:1783141894.023602:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1783141894.023764:0:12773:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1783141894.878686:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141895.899622:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141896.927310:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783141897.046351:0:12927:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783141897.067688:0:12927:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783141897.067731:0:12927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.067747:0:12927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.067754:0:12927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.067761:0:12927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.067779:0:12927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783141897.067784:0:12927:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783141897.067809:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783141897.067814:0:12927:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783141897.067820:0:12927:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783141897.067826:0:12927:0:(import.c:65:import_set_state_nolock()) ffff946381372000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783141897.067830:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783141897.067832:0:12927:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783141897.067835:0:12927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783141897.068301:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141897.068308:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.068316:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6600 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141897.068319:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.068328:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141897.068336:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141897.068342:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783141897.068344:0:7492:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783141897.068347:0:7492:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783141897.068378:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.068384:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783141897.068437:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510561152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141897.068525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783141897.069086:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.069097:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff94649d0d6600/0x279ffa91da8986cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.069110:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141897.069121:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141897.069123:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141897.071056:0:12927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.071086:0:12927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.071092:0:12927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.071099:0:12927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.071125:0:12927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783141897.071131:0:12927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.071138:0:12927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141897.071270:0:7493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510561152 00000100:00100000:3.0:1783141897.071279:0:7493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510561152 00000100:00100000:3.0:1783141897.071320:0:7493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783141897.071328:0:7493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3308:x1869759510561152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783141897.071334:0:7493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783141897 with bad export cookie 2855276193119830951 00010000:00010000:0.0:1783141897.073232:0:12927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.073241:0:12927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141897.073263:0:12927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783141897.073268:0:12927:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1783141897.073305:0:12927:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783141897.073309:0:12927:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1783141897.073315:0:12927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783141897.073319:0:12927:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783141897.073334:0:12927:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9464bfed0000) has no exports 00000020:00080000:0.0:1783141897.073359:0:12927:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9464bfed0000) has no exports 00010000:00010000:1.0:1783141897.073965:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783141897.073983:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.073992:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174400 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141897.073995:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.074006:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141897.074013:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141897.074019:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783141897.074021:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1783141897.074024:0:5776:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1783141897.074061:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.074077:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141897.074100:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.074108:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2174400/0x279ffa91da8986da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da8986e1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.074121:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141897.074125:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.074139:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141897.074142:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.074150:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141897.074324:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141897.074329:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783141897.074331:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783141897.074333:0:5776:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783141897.074350:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.074355:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141897.074361:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.074367:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946496f53800/0x279ffa91da8988fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x279ffa91da898903 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141897.074377:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141897.074378:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141897.074380:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783141897.074398:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510561280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783141897.074639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141897.074690:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141897.074702:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510561408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783141897.074726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141897.074864:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141897.074887:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510561280 00000100:00100000:2.0:1783141897.074893:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510561280 00000100:00100000:2.0:1783141897.075076:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510561408 00000100:00100000:2.0:1783141897.075080:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510561408 00000100:00100000:1.0:1783141897.075113:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783141897.075120:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1869759510561280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783141897.075126:0:5774:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783141897 with bad export cookie 2855276193119830951 00000100:00100000:1.0:1783141897.075231:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1869759510561280:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (592us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783141897.075238:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783141897.075257:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783141897.075261:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1869759510561408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783141897.075266:0:5774:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783141897 with bad export cookie 2855276193119830951 00000100:00100000:1.0:1783141897.075291:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1869759510561408:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (564us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783141897.075297:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1783141897.075325:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783141897.075329:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464830b9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783141897.075333:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:0.0:1783141897.079723:0:12927:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9464bfe5fba0 - data ffff94648709c798/ffff9464972a9800 00000020:01000000:0.0:1783141897.079863:0:12927:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94649d283ba0 - data ffff9464872d7798/ffff9463812fd400 00000100:00100000:3.0:1783141897.084645:0:7493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3308:x1869759510561152:12345-0@lo:103:ldlm_bl.0 Request processed in 13311us (16125us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783141897.084657:0:7493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1783141897.084679:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783141897.102444:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.127@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783141897.102450:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783141897.102485:0:3305:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff946485002a00 x1869759510561152/t0(0) o103->MGC192.168.203.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783141913 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141897.102499:0:3305:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff946485001880 x1869759510561280/t0(0) o103->MGC192.168.203.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783141913 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141897.102508:0:3305:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff946485003480 x1869759510561408/t0(0) o103->MGC192.168.203.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783141913 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783141897.102605:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783141897.102625:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783141897.102627:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783141897.104965:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9464830b9000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1783141897.104995:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:872ec41a-f648-467b-b036-39669ac398c4:3308:1869759510561152:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783141897.105546:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9464830b9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783141897.105552:0:3305:0:(import.c:512:import_select_connection()) MGC192.168.203.127@tcp: connect to NID 0@lo last attempt 190 00000100:00080000:1.0:1783141897.105561:0:3305:0:(import.c:626:import_select_connection()) MGC192.168.203.127@tcp: import ffff9464830b9000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1783141897.105595:0:3305:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946485000000 x1869759510561536/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141897.105635:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510561280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783141897.105651:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:872ec41a-f648-467b-b036-39669ac398c4:3305:1869759510561408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141897.105672:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:872ec41a-f648-467b-b036-39669ac398c4:3304:1869759510561536:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1783141897.105722:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869759510561536 offset 0 length 520: 4 00100000:10000000:0.0:1783141897.113501:0:12927:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783141897.138772:0:12927:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8984cd 00000020:00000080:1.0:1783141897.138781:0:12927:0:(genops.c:906:class_export_put()) final put ffff9464bfee4000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783141897.138794:0:12927:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94649d28d000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783141897.138798:0:12927:0:(obd_mount.c:701:lustre_put_lsi()) put ffff94649d28d000 2 00000020:01000004:1.0:1783141897.138801:0:12927:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94649d28d000 from lustre-OST0000 00000020:00000080:1.0:1783141897.138826:0:12927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141897.138835:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783141897.138838:0:12927:0:(genops.c:906:class_export_put()) final put ffff9464bfc24800/lustre-OST0000_UUID 00000020:00000080:1.0:1783141897.138841:0:12927:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bfc24800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783141897.138849:0:12927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783141897.138889:0:12927:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783141897.138894:0:12927:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783141897.138897:0:12927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141897.138902:0:12927:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783141897.138908:0:12927:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff946381373000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141897.138913:0:12927:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9464bfed3380) has exports, disconnecting them 00000020:00080000:1.0:1783141897.138918:0:12927:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff946381373000), last request at 1783141697 00000020:00000080:1.0:1783141897.138922:0:12927:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8984f7 00000020:00080000:1.0:1783141897.138932:0:12927:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff946381373000): rc 0 00000020:00000080:1.0:1783141897.138950:0:12927:0:(genops.c:906:class_export_put()) final put ffff946381373000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783141897.140310:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bfee4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783141897.140327:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946381373000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783141897.141509:0:12927:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783141897.141516:0:12927:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783141897.141520:0:12927:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783141897.141527:0:12927:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783141897.141590:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff946381372000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783141897.141677:0:12927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141897.141685:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783141897.141690:0:12927:0:(genops.c:906:class_export_put()) final put ffff9464bfee7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783141897.141694:0:12927:0:(genops.c:865:class_export_destroy()) destroying export ffff9464bfee7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1783141897.141698:0:12927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1783141897.141755:0:12927:0:(obd_mount.c:701:lustre_put_lsi()) put ffff94649d28d000 1 00000020:00000080:2.0:1783141897.141760:0:12927:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898487 00000020:00000080:2.0:1783141897.141766:0:12927:0:(genops.c:906:class_export_put()) final put ffff946496820800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783141897.141779:0:12927:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1783141897.141784:0:12927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141897.141788:0:12927:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783141897.141792:0:12927:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff946493cc19c0) has no exports 00000020:00000080:3.0:1783141897.141798:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946496820800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783141897.153433:0:12927:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141897.153450:0:12927:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1783141897.153455:0:12927:0:(genops.c:906:class_export_put()) final put ffff94649d288000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1783141897.153476:0:12927:0:(genops.c:865:class_export_destroy()) destroying export ffff94649d288000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1783141897.153484:0:12927:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1783141897.153636:0:12927:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff94649d289000 00000020:02000400:2.0:1783141897.153701:0:12927:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1783141897.951751:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783141898.270194:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) 872ec41a-f648-467b-b036-39669ac398c4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783141898.270204:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) 872ec41a-f648-467b-b036-39669ac398c4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783141898.270207:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783141898.270211:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783141898.270215:0:38:0:(import.c:65:import_set_state_nolock()) ffff9464b9d65800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141898.270223:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 400 00000100:00080000:2.0:1783141898.270229:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783141898.270236:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9464b9d65800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141898.270277:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496b24700 x1869759510561664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783141898.270516:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1869759510561664:0@lo:38:kworker.0 00000400:00000100:1.0:1783141898.270569:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869759510561664 offset 0 length 520: 4 00010000:00010000:1.0:1783141898.974929:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141899.995814:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783141900.012106:0:13077:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783141900.024800:0:13077:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1783141900.024910:0:13077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.024929:0:13077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.024937:0:13077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.024945:0:13077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.024976:0:13077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783141900.024996:0:13077:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783141900.025025:0:13077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783141900.025041:0:13077:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff946496b24700 x1869759510561664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783141913 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141900.025118:0:13077:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783141900.025135:0:13077:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783141900.025143:0:13077:0:(import.c:65:import_set_state_nolock()) ffff9464b9d65800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1783141900.025148:0:13077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783141900.025152:0:13077:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff946496b24700 x1869759510561664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783141913 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783141900.025197:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141900.025212:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.025221:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a6800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:3.0:1783141900.025225:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.025236:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141900.025243:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141900.025249:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783141900.025251:0:7492:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783141900.025254:0:7492:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783141900.025270:0:7492:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9464830b9000 00010000:00010000:3.0:1783141900.025275:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.025281:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464814a6800/0x279ffa91da8986b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x279ffa91da8986b7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141900.025293:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141900.025295:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141900.025296:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141900.027587:0:13077:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783141900.027670:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1869759510561664:0@lo:38:kworker.0 00000100:00100000:2.0:1783141900.027725:0:13077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783141900.029953:0:13077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.029976:0:13077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.029984:0:13077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.029992:0:13077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.030126:0:13077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783141900.030137:0:13077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.030145:0:13077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.030168:0:13077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141900.030174:0:13077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.030280:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783141900.030288:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.030296:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464814a7800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141900.030300:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.030309:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141900.030317:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141900.030323:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783141900.030326:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1783141900.030340:0:5776:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9464830b9000 00010000:00010000:1.0:1783141900.030344:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.030351:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464814a7800/0x279ffa91da8986be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x279ffa91da8986c5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.030371:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141900.030374:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.030393:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6e00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141900.030396:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.030402:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141900.030409:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141900.030414:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783141900.030417:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1783141900.030421:0:5776:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9464830b9000 00010000:00010000:1.0:1783141900.030424:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.030431:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141900.030433:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141900.030435:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141900.030706:0:13077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783141900.030713:0:13077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff94649d0d6e00/0x279ffa91da8988e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x279ffa91da8988ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141900.030730:0:13077:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1783141900.030736:0:13077:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1783141900.030738:0:13077:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1783141900.030772:0:13077:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1783141900.030778:0:13077:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1783141900.030786:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141900.030793:0:13077:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783141900.030797:0:13077:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9464972b4d40) has no exports 00000020:00080000:2.0:1783141900.030828:0:13077:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9464972b4d40) has no exports 00000020:01000000:2.0:1783141900.037373:0:13077:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9464bfe5f000 - data ffff94648709ce58/ffff9464972a9000 00010000:00010000:3.0:1783141900.037647:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783141900.037849:0:13077:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94649d18b240 - data ffff94649771a438/ffff946489ab8c00 00100000:10000000:2.0:1783141900.056678:0:13077:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783141900.099105:0:13077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8985a6 00000020:00000080:1.0:1783141900.099117:0:13077:0:(genops.c:906:class_export_put()) final put ffff946497295000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1783141900.099250:0:13077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946381363000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1783141900.099255:0:13077:0:(obd_mount.c:701:lustre_put_lsi()) put ffff946381363000 2 00000020:01000004:1.0:1783141900.099259:0:13077:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946381363000 from lustre-OST0001 00000020:00000080:1.0:1783141900.099288:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141900.099302:0:13077:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1783141900.099305:0:13077:0:(genops.c:906:class_export_put()) final put ffff946497291000/lustre-OST0001_UUID 00000020:00000080:1.0:1783141900.099309:0:13077:0:(genops.c:865:class_export_destroy()) destroying export ffff946497291000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1783141900.099317:0:13077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1783141900.099528:0:13077:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 872ec41a-f648-467b-b036-39669ac398c4->MGS 00010000:00010000:1.0:1783141900.099547:0:13077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464c2043e00/0x279ffa91da8984aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da8984b1 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141900.099560:0:13077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464c2043e00/0x279ffa91da8984aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da8984b1 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141900.099568:0:13077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1783141900.099571:0:13077:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1783141900.099575:0:13077:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1783141900.099593:0:13077:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9464830b9000 00010000:00010000:1.0:1783141900.099598:0:13077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464c2043e00/0x279ffa91da8984aa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x279ffa91da8984b1 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141900.099629:0:13077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x279ffa91da89870b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141900.099637:0:13077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x279ffa91da89870b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141900.099642:0:13077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783141900.099644:0:13077:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1783141900.099646:0:13077:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1783141900.099657:0:13077:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9464830b9000 00010000:00010000:1.0:1783141900.099660:0:13077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff94649d0d7200/0x279ffa91da898704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x279ffa91da89870b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783141900.099678:0:13077:0:(import.c:65:import_set_state_nolock()) ffff9464830b9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1783141900.099683:0:13077:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783141900.099686:0:13077:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783141900.099688:0:13077:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783141900.099693:0:13077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783141900.099716:0:13077:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff946485000000 x1869759510561536/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783141907 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783141900.099732:0:13077:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783141900.099736:0:13077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1783141900.099887:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:872ec41a-f648-467b-b036-39669ac398c4:3304:1869759510561536:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:1.0:1783141900.099975:0:13077:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783141900.099984:0:13077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898399 00000020:00000080:1.0:1783141900.099990:0:13077:0:(genops.c:906:class_export_put()) final put ffff946482f0f000/872ec41a-f648-467b-b036-39669ac398c4 00000020:00000080:2.0:1783141900.100576:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946497295000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783141900.100760:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946482f0f000/872ec41a-f648-467b-b036-39669ac398c4 for MGC192.168.203.127@tcp 00000020:01000000:1.0:1783141900.100848:0:13077:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.127@tcp (flags='') 00000020:00000080:1.0:1783141900.100856:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141900.100863:0:13077:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.127@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783141900.100869:0:13077:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff946482f299c0) has no exports 10000000:01000000:3.0:1783141900.101057:0:5784:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1783141900.101351:0:13077:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.127@tcp: client import never connected 00000100:00080000:1.0:1783141900.101357:0:13077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1783141900.101360:0:13077:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783141900.101364:0:13077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1783141900.101367:0:13077:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783141900.101455:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783141900.101499:0:13077:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.127@tcp (uuid 872ec41a-f648-467b-b036-39669ac398c4) 00000020:01000000:1.0:1783141900.101508:0:13077:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1783141900.101511:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783141900.101516:0:13077:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783141900.101523:0:13077:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff946497220800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783141900.101529:0:13077:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff946482f2b380) has exports, disconnecting them 00000020:00080000:1.0:1783141900.101534:0:13077:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff946497220800), last request at 1783141714 00000020:00000080:1.0:1783141900.101540:0:13077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da8985d0 00000020:00080000:1.0:1783141900.101556:0:13077:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff946497220800): rc 0 00000020:00000080:1.0:1783141900.101561:0:13077:0:(genops.c:906:class_export_put()) final put ffff946497220800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783141900.102157:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9464830b9000 for MGC192.168.203.127@tcp 00000020:00000080:2.0:1783141900.102169:0:8:0:(genops.c:906:class_export_put()) final put ffff9464830b9800/872ec41a-f648-467b-b036-39669ac398c4 00000020:00000080:2.0:1783141900.102173:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9464830b9800/872ec41a-f648-467b-b036-39669ac398c4 for MGC192.168.203.127@tcp 00000020:01000000:2.0:1783141900.102181:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.127@tcp (872ec41a-f648-467b-b036-39669ac398c4) 00000020:00000080:2.0:1783141900.103197:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946497220800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783141900.107579:0:13077:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783141900.107592:0:13077:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783141900.107598:0:13077:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783141900.107607:0:13077:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783141900.107732:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1783141900.107903:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9464b9d65800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1783141900.107997:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1783141900.108268:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1783141900.108577:0:5770:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff946489d1e000:5770] 0 exiting: rc = 1 00000100:00100000:0.0:1783141900.108693:0:5771:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff946488200600:5771] 1 exiting: rc = 0 00000100:00100000:2.0:1783141900.108833:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109151:0:6600:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9464bfe40c00:6600] 3 exiting: rc = 0 00000100:00100000:2.0:1783141900.109217:0:5773:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff946482d16800:5773] 1 exiting: rc = 0 00000100:00100000:3.0:1783141900.109424:0:5774:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff946482d16000:5774] 2 exiting: rc = 0 00000100:00100000:3.0:1783141900.109506:0:7493:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff94649681d600:7493] 4 exiting: rc = 0 00000100:00100000:2.0:1783141900.109657:0:5772:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff946482d17600:5772] 0 exiting: rc = 1 00000100:00100000:2.0:1783141900.109716:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109725:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109733:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109740:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109747:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109753:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109760:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109767:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109775:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109782:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109792:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109797:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109804:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109811:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109818:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109824:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109830:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109836:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109841:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109846:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109851:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109857:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109862:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109868:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109892:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109897:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109903:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109909:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109915:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109920:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109925:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109931:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109939:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109957:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109964:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109970:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109974:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109979:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109985:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109990:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.109995:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110001:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110007:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110013:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110018:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110023:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110029:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110035:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110040:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110057:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110063:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110070:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110076:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110081:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110087:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110094:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110100:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110106:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110114:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110243:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110249:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110255:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110270:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.110277:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783141900.111449:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141900.111517:0:13077:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783141900.111524:0:13077:0:(genops.c:906:class_export_put()) final put ffff946489d49000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783141900.111530:0:13077:0:(genops.c:865:class_export_destroy()) destroying export ffff946489d49000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783141900.111541:0:13077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1783141900.111598:0:13077:0:(obd_mount.c:701:lustre_put_lsi()) put ffff946381363000 1 00000020:00000080:2.0:1783141900.111605:0:13077:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x279ffa91da898575 00000020:00000080:2.0:1783141900.111613:0:13077:0:(genops.c:906:class_export_put()) final put ffff946489d48800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1783141900.111661:0:13077:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1783141900.111668:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141900.111673:0:13077:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783141900.111677:0:13077:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9464bab38000) has no exports 00000020:00000080:3.0:1783141900.112901:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff946489d48800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783141900.132721:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141900.132743:0:13077:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783141900.132751:0:13077:0:(genops.c:906:class_export_put()) final put ffff946381360000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783141900.132758:0:13077:0:(genops.c:865:class_export_destroy()) destroying export ffff946381360000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783141900.132772:0:13077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1783141900.133042:0:13077:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff946381364000 00000020:01000000:2.0:1783141900.133083:0:13077:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1783141900.133089:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783141900.133094:0:13077:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783141900.133099:0:13077:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff946496e099c0) has no exports 00000020:00000080:2.0:1783141900.133159:0:13077:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783141900.133166:0:13077:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1783141900.133169:0:13077:0:(genops.c:906:class_export_put()) final put ffff946496824800/OSS_uuid 00000020:00000080:2.0:1783141900.133172:0:13077:0:(genops.c:865:class_export_destroy()) destroying export ffff946496824800/OSS_uuid for OSS 00000020:01000000:2.0:1783141900.133176:0:13077:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1783141900.133208:0:5783:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1783141900.133425:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff946496e00200:6584] 0 exiting: rc = 1 00000100:00100000:1.0:1783141900.134535:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9464883bf000:6587] 2 exiting: rc = 0 00000100:00100000:1.0:1783141900.134618:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff94648309cc00:6586] 1 exiting: rc = 0 00000100:00100000:0.0:1783141900.134789:0:10144:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9464972c4c00:10144] 3 exiting: rc = 0 00000100:00100000:2.0:1783141900.135014:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135025:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135032:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135039:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135054:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135060:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135066:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135071:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135076:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135080:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135085:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135090:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135095:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135100:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135105:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135110:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135115:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135128:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135134:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135139:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135144:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135148:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135153:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135157:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135161:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135166:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135172:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135177:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135182:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135187:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135191:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135197:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135202:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135206:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135225:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135230:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135236:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135241:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135246:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135251:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135256:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135261:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135267:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135273:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135279:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135285:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135291:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135297:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135303:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135309:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135316:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135325:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135331:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135337:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135342:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135347:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135353:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135359:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135365:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135370:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135375:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135381:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135386:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.135390:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.136192:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff946489cd3c00:6589] 1 exiting: rc = 0 00000100:00100000:0.0:1783141900.136784:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94648309c000:6588] 0 exiting: rc = 1 00000100:00100000:0.0:1783141900.136847:0:8073:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9464972a7a00:8073] 2 exiting: rc = 0 00000100:00100000:2.0:1783141900.136992:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137002:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137009:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137013:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137030:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137034:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137040:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137056:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137063:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137068:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137074:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137080:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137085:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137090:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137095:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137100:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137105:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137110:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137116:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137244:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137250:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137256:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137266:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137272:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137279:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137284:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137290:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137296:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137302:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137308:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137314:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137319:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137324:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137330:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137335:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137341:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137348:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137354:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137360:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137374:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137380:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137386:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137391:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137396:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137402:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137408:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137414:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137419:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137426:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137431:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137437:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137442:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137448:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137453:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137562:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137568:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137574:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137579:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137588:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137593:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137599:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137605:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137610:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.137615:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.141612:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94648832f200:6591] 1 exiting: rc = 0 00000100:00100000:1.0:1783141900.142031:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9464ba1f4200:6590] 0 exiting: rc = 1 00000100:00100000:0.0:1783141900.142587:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff94648832ee00:6592] 2 exiting: rc = 0 00000100:00100000:0.0:1783141900.142781:0:11838:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9464995e2600:11838] 3 exiting: rc = 0 00000100:00100000:2.0:1783141900.142978:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.142987:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.142993:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.142999:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143005:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143010:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143026:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143035:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143040:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143071:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143077:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143082:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143088:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143093:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143099:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143106:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143112:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143128:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143135:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143141:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143147:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143153:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143160:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143178:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143185:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143202:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143208:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143214:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143221:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143227:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143233:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143239:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143245:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143251:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143256:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143262:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143269:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143274:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143280:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143287:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143293:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143300:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143307:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143313:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143328:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143334:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143340:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143360:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143367:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143374:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143380:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143386:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143391:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143397:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143404:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143411:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143417:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143424:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143430:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143437:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143443:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143449:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143455:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.143483:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.156179:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff946489023a00:6594] 1 exiting: rc = 0 00000100:00100000:3.0:1783141900.156433:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff94648832fc00:6593] 0 exiting: rc = 1 00000100:00100000:1.0:1783141900.156570:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156595:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156601:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156607:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156612:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156618:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156623:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156628:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156634:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156639:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156645:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156651:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156657:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156662:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156667:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156673:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156678:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156683:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156689:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156694:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156700:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156706:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156712:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156717:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156723:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156729:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156734:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156740:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156746:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156751:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156756:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156762:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156767:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156772:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156778:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156783:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156796:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156801:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156807:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156812:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156818:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156824:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156831:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156837:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156842:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156847:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156852:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156858:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156863:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156868:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156873:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156879:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156884:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156890:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156896:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156901:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156907:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156913:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156919:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156925:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156931:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156937:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156943:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.156964:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783141900.158023:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff946489023200:6595] 0 exiting: rc = 1 00000100:00100000:3.0:1783141900.158281:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff946489b50200:6596] 1 exiting: rc = 0 00000100:00100000:1.0:1783141900.158443:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158451:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158490:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158499:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158507:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158514:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158522:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158545:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158551:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158558:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158565:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158573:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158600:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158608:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158615:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158624:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158630:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158637:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158648:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158655:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158662:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158668:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158675:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158685:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158707:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158715:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158720:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158727:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158732:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158738:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158744:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158751:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158758:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158765:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158771:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158778:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158799:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158810:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158819:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158827:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158835:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158842:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158856:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158863:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158870:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158876:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158883:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158892:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158917:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158926:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158933:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.158940:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159189:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159198:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159204:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159211:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159217:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159224:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159230:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159237:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159244:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159265:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159280:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783141900.159301:0:13077:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1783141900.175368:0:13077:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1783141916.619651:0:13692:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1783141923.702106:0:14105:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783141923.702120:0:14105:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1783141923.702239:0:14105:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9464bb12d800 00000020:01000004:1.0:1783141923.702265:0:14105:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783141923.702273:0:14105:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1783141923.702287:0:14105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9464972b4d40) 00000020:00000080:1.0:1783141923.702301:0:14105:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783141923.716294:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783141923.718452:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1783141923.718947:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 435: rc = 0 00100000:10000000:0.0:1783141923.719088:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 435: rc = 0 00100000:10000000:0.0:1783141923.719271:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783141923.719341:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 435: rc = 0 00100000:10000000:0.0:1783141923.719439:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 435: rc = 0 00100000:10000000:0.0:1783141923.719670:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 435: rc = 0 00100000:10000000:0.0:1783141923.720046:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 435: rc = 0 00100000:10000000:0.0:1783141923.720337:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 437: rc = 0 00100000:10000000:0.0:1783141923.721621:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 483: rc = 0 00100000:10000000:0.0:1783141923.721729:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 483: rc = 0 00100000:10000000:0.0:1783141923.722197:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 484: rc = 0 00100000:10000000:0.0:1783141923.722893:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 484: rc = 0 00100000:10000000:0.0:1783141923.723148:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 484: rc = 0 00100000:10000000:0.0:1783141923.723408:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 484: rc = 0 00100000:10000000:0.0:1783141923.723775:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 484: rc = 0 00100000:10000000:0.0:1783141923.724019:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 484: rc = 0 00100000:10000000:0.0:1783141923.724252:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 484: rc = 0 00100000:10000000:0.0:1783141923.724713:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 484: rc = 0 00100000:10000000:0.0:1783141923.724991:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 484: rc = 0 00100000:10000000:0.0:1783141923.725239:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 484: rc = 0 00100000:10000000:0.0:1783141923.725800:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 484: rc = 0 00100000:10000000:0.0:1783141923.726422:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 484: rc = 0 00100000:10000000:0.0:1783141923.730490:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 500: rc = 0 00100000:10000000:0.0:1783141923.731446:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 500: rc = 0 00100000:10000000:0.0:1783141923.731967:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 500: rc = 0 00100000:10000000:0.0:1783141923.732431:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 500: rc = 0 00100000:10000000:0.0:1783141923.733970:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 500: rc = 0 00100000:10000000:0.0:1783141923.734272:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 500: rc = 0 00100000:10000000:0.0:1783141923.734623:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 500: rc = 0 00100000:10000000:0.0:1783141923.734871:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 500: rc = 0 00100000:10000000:0.0:1783141923.735134:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 500: rc = 0 00100000:10000000:0.0:1783141923.735598:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 500: rc = 0 00100000:10000000:0.0:1783141923.735858:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 500: rc = 0 00100000:10000000:0.0:1783141923.736114:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 500: rc = 0 00100000:10000000:0.0:1783141923.736365:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 500: rc = 0 00100000:10000000:0.0:1783141923.736746:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 500: rc = 0 00100000:10000000:0.0:1783141923.737027:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 500: rc = 0 00100000:10000000:0.0:1783141923.737271:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 500: rc = 0 00100000:10000000:0.0:1783141923.737701:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 500: rc = 0 00100000:10000000:0.0:1783141923.738013:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 500: rc = 0 00100000:10000000:0.0:1783141923.738266:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 500: rc = 0 00100000:10000000:0.0:1783141923.739053:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 500: rc = 0 00100000:10000000:0.0:1783141923.739310:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 500: rc = 0 00100000:10000000:0.0:1783141923.739591:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 500: rc = 0 00100000:10000000:0.0:1783141923.739932:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 500: rc = 0 00100000:10000000:0.0:1783141923.740183:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 500: rc = 0 00100000:10000000:0.0:1783141923.740428:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 500: rc = 0 00100000:10000000:0.0:1783141923.740700:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 500: rc = 0 00100000:10000000:0.0:1783141923.741156:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 500: rc = 0 00100000:10000000:0.0:1783141923.741396:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 500: rc = 0 00100000:10000000:0.0:1783141923.742022:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 500: rc = 0 00100000:10000000:0.0:1783141923.742272:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 500: rc = 0 00100000:10000000:0.0:1783141923.742641:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 500: rc = 0 00100000:10000000:0.0:1783141923.742971:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 500: rc = 0 00100000:10000000:0.0:1783141923.743319:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 654: rc = 0 00100000:10000000:0.0:1783141923.743975:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1783141923.744285:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:0.0:1783141923.744614:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1783141923.744688:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:0.0:1783141923.744976:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1783141923.745045:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:0.0:1783141923.745984:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1783141923.746055:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 383: rc = 0 00100000:10000000:0.0:1783141923.746250:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1783141923.746320:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 383: rc = 0 00100000:10000000:0.0:1783141923.746887:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1783141923.746959:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 383: rc = 0 00000020:00000080:0.0:1783141923.747208:0:14105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783141923.747216:0:14105:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783141923.747228:0:14105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da89969a 00000020:01000004:0.0:1783141923.747236:0:14105:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1783141923.747241:0:14105:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783141923.747247:0:14105:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9464bb12d800 from MGS 00000020:01000004:0.0:1783141923.747250:0:14105:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783141923.747260:0:14105:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9464bfed3380) 00000020:00000080:0.0:1783141923.747273:0:14105:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783141923.747323:0:14105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464bb12d800 from MGS, refs=2 00080000:01000000:0.0:1783141923.747327:0:14105:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783141923.747335:0:14105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da8996a8 00000100:00100000:0.0:1783141923.747421:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783141923.747655:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783141923.747661:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783141923.748254:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783141923.748260:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783141923.749009:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141923.749143:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783141923.749149:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783141923.749678:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783141923.749685:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783141923.750117:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783141923.750379:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783141923.751181:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141923.751184:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141923.751186:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141923.751387:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141923.751390:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141923.751391:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141923.752087:0:14105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783141923.757810:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783141923.767737:0:14105:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1783141923.767755:0:14105:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783141923.767758:0:14105:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1783141923.769288:0:14114:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783141923.769422:0:14105:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783141923.769556:0:14105:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783141923.770112:0:14105:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783141923.770417:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141923.770597:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783141923.770603:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783141923.771308:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783141923.771315:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783141923.771725:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783141923.771731:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783141923.772453:0:14105:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783141923.772494:0:14105:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.127@tcp' 00000020:01000004:0.0:1783141923.772497:0:14105:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783141923.772526:0:14105:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.127@tcp (typ=mgc) 00000020:00000080:0.0:1783141923.772539:0:14105:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.127@tcp (ffff9464bfed0000) 00000020:00000080:0.0:1783141923.772617:0:14105:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783141923.772691:0:14105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946497293000@MGC192.168.203.127@tcp: add connection 192.168.203.127@tcp at head 00000100:00080000:1.0:1783141923.772969:0:14118:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1783141923.773052:0:14105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.127@tcp-0 is initialized 00000040:01000000:0.0:1783141923.773059:0:14105:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 1 is initialized 10000000:01000000:0.0:1783141923.775173:0:14119:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783141923.775273:0:14105:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.127@tcp (uuid dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55) 00000020:00000080:1.0:1783141923.775294:0:14105:0:(genops.c:1406:class_connect()) connect: client dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55, cookie 0x279ffa91da8996b6 00000100:00080000:1.0:1783141923.775306:0:14105:0:(import.c:512:import_select_connection()) MGC192.168.203.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783141923.775313:0:14105:0:(import.c:626:import_select_connection()) MGC192.168.203.127@tcp: import ffff946497293000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:1.0:1783141923.775352:0:14105:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946485003480 x1869759510561792/t0(0) o250->MGC192.168.203.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783141923.775431:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3304:1869759510561792:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783141923.775574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783141923.775653:0:14105:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55->MGS 00000020:01000004:1.0:1783141923.775678:0:14105:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783141923.775708:0:14105:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783141923.775722:0:14105:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9464972b0000) 00000020:00000080:1.0:1783141923.775742:0:14105:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1783141923.782611:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510561792 00000100:00100000:0.0:1783141923.782625:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510561792 00000100:00100000:0.0:1783141923.782741:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141923.782758:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1869759510561792:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783141923.782853:0:14115:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:0.0:1783141923.782892:0:14115:0:(genops.c:1406:class_connect()) connect: client dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55, cookie 0x279ffa91da8996c4 00000100:00080000:0.0:1783141923.783019:0:14115:0:(import.c:65:import_set_state_nolock()) ffff946497294000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141923.783116:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+5:3304:x1869759510561792:12345-0@lo:250:mount.lustre.0 Request processed in 358us (7547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141923.783124:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141923.783214:0:3304:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783141923.783223:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.127@tcp: connect to target with instance 0 00000100:00080000:3.0:1783141923.783231:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783141923.783235:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783141923.783246:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946497293000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783141923.783248:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783141923.783263:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783141923.783270:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3304:1869759510561792:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783141923.789173:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783141923.789398:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783141923.789404:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783141923.790400:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783141923.790409:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783141923.790867:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783141923.790874:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783141923.791594:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783141923.792252:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783141923.792258:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783141923.796927:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783141923.796938:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783141923.837603:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783141923.838034:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783141923.838049:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783141923.839262:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783141923.839273:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783141923.840013:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783141923.840162:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783141923.840168:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783141923.840968:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783141923.840976:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783141923.841530:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783141923.841874:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783141923.841891:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783141923.842393:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783141923.842400:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783141923.843215:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783141923.843352:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783141923.843357:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783141923.844079:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783141923.844086:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783141923.860333:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141923.860567:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783141923.860574:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783141923.862193:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783141923.862204:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783141923.863201:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783141923.863210:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1783141923.870437:0:14105:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1783141923.870487:0:14105:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1783141923.870494:0:14105:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783141923.870621:0:14105:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783141923.870672:0:14105:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.127@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1783141923.870676:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783141923.870678:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141923.870679:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141923.870681:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141923.870682:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141923.870683:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141923.870685:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141923.870686:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141923.870688:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141923.870689:0:14105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783141923.870692:0:14105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1783141923.870694:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783141923.870695:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141923.870696:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141923.870697:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141923.870698:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141923.870699:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141923.870700:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141923.870702:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141923.870702:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141923.870703:0:14105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783141923.870745:0:14105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783141923.870765:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510561920:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783141923.871010:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141923.871062:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141923.871138:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510561920 00000100:00100000:0.0:1783141923.871145:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510561920 00000100:00100000:0.0:1783141923.871186:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141923.871195:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+5:14105:x1869759510561920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783141923.871241:0:14117:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783141923.871244:0:14117:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783141923.871248:0:14117:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783141923.872253:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783141923.873089:0:14117:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1783141923.880633:0:14140:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783141923.880649:0:14140:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783141923.880652:0:14140:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783141923.880694:0:14140:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1783141923.880983:0:14117:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783141923.880993:0:14117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783141923.891964:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+5:14105:x1869759510561920:12345-0@lo:253:mount.lustre.0 Request processed in 20762us (20946us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141923.891981:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141923.892081:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510561920:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783141923.892140:0:14105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783141923.892143:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783141923.892145:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783141923.892146:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783141923.892147:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783141923.892148:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783141923.892150:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783141923.892151:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783141923.892152:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783141923.892155:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783141923.892156:0:14105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783141923.892176:0:14105:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9464bb12d800 from lustre-MDT0000 10000000:01000000:3.0:1783141923.892201:0:14105:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783141923.892204:0:14105:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783141923.892208:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9464bfed0000 10000000:01000000:3.0:1783141923.892213:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783141923.892220:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9464bfed0000 from 1 10000000:01000000:3.0:1783141923.892223:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783141923.892258:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.892269:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.892278:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141923.892297:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783141923.892329:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141923.892368:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e840 going to sleep for 11 seconds 00000100:00100000:0.0:1783141923.892582:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510562048 00000100:00100000:0.0:1783141923.892589:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510562048 00000100:00100000:0.0:1783141923.892625:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141923.892633:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+5:14105:x1869759510562048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783141923.892645:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141923.892659:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94649d0d6c00/0x279ffa91da8996d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8996cb expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141923.892679:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d6c00/0x279ffa91da8996d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8996cb expref: 6 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141923.892707:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94649d0d6c00/0x279ffa91da8996d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8996cb expref: 6 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141923.892716:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6c00, rc 0) 00000100:00100000:0.0:1783141923.892745:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+6:14105:x1869759510562048:12345-0@lo:101:mount.lustre.0 Request processed in 113us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141923.892750:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141923.892928:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141923.892941:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141923.892950:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141923.892997:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141923.893027:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141923.893054:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489a34e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783141923.897715:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510562176 00000100:00100000:0.0:1783141923.897742:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510562176 00000100:00100000:0.0:1783141923.897809:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141923.897819:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+6:14105:x1869759510562176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783141923.898122:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+6:14105:x1869759510562176:12345-0@lo:501:mount.lustre.0 Request processed in 303us (5092us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783141923.898131:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141923.898237:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485001880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562176:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783141923.898289:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783141923.898314:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.898325:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141923.898333:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9464bb12d800 10000000:01000000:3.0:1783141923.898338:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783141923.898343:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9464bb12d800 10000000:01000000:3.0:1783141923.898346:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783141923.898349:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9464bb12d800 from 1 10000000:01000000:3.0:1783141923.898352:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783141923.898381:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17a00/0x279ffa91da8996d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.898389:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464bfe17a00/0x279ffa91da8996d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.898398:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464bfe17a00/0x279ffa91da8996d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141923.898417:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783141923.898453:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141923.898518:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e000 going to sleep for 11 seconds 00000100:00100000:2.0:1783141923.898598:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510562304 00000100:00100000:2.0:1783141923.898603:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510562304 00000100:00100000:2.0:1783141923.898631:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141923.898645:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+6:14105:x1869759510562304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141923.898654:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141923.898666:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a1e00/0x279ffa91da8996e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8996d9 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141923.898686:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a1e00/0x279ffa91da8996e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8996d9 expref: 7 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141923.898696:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a1e00/0x279ffa91da8996e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8996d9 expref: 7 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141923.898705:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1e00, rc 0) 00000100:00100000:2.0:1783141923.898733:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+7:14105:x1869759510562304:12345-0@lo:101:mount.lustre.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141923.898739:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783141923.898999:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141923.899012:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464bfe17a00/0x279ffa91da8996d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996e0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.899031:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464bfe17a00/0x279ffa91da8996d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8996e0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141923.899044:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783141923.899048:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17a00/0x279ffa91da8996d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996e0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.899053:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe17a00/0x279ffa91da8996d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996e0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141923.899059:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783141923.899062:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783141923.899067:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9464bb12d800 10000000:01000000:3.0:1783141923.899070:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783141923.899072:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783141923.899074:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783141923.899089:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17800/0x279ffa91da8996e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.899096:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464bfe17800/0x279ffa91da8996e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.899103:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464bfe17800/0x279ffa91da8996e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141923.899115:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783141923.899152:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141923.899178:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141923.899200:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510562432 00000100:00100000:3.0:1783141923.899204:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510562432 00000100:00100000:3.0:1783141923.899222:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783141923.899227:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+7:14105:x1869759510562432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141923.899234:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141923.899242:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464bfe16e00/0x279ffa91da8996ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8996e7 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.899254:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464bfe16e00/0x279ffa91da8996ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8996e7 expref: 8 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.899261:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464bfe16e00/0x279ffa91da8996ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8996e7 expref: 8 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.899267:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16e00, rc 0) 00000100:00100000:3.0:1783141923.899294:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+8:14105:x1869759510562432:12345-0@lo:101:mount.lustre.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141923.899300:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783141923.899329:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141923.899339:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464bfe17800/0x279ffa91da8996e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996ee expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141923.899347:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464bfe17800/0x279ffa91da8996e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8996ee expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141923.899385:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141923.899410:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141923.899423:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141923.899440:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510562560 00000100:00100000:3.0:1783141923.899443:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510562560 00000100:00100000:3.0:1783141923.899483:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141923.899489:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+8:14105:x1869759510562560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141923.899813:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+9:14105:x1869759510562560:12345-0@lo:501:mount.lustre.0 Request processed in 323us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141923.899820:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141923.899847:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141923.899871:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783141923.899917:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141923.899928:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783141923.899939:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510562688 00000100:00100000:3.0:1783141923.899942:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510562688 00000100:00100000:3.0:1783141923.899957:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141923.899962:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+9:14105:x1869759510562688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783141923.900209:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+9:14105:x1869759510562688:12345-0@lo:503:mount.lustre.0 Request processed in 245us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141923.900215:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141923.900245:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510562688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783141923.900541:0:14141:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14141:1869759510562816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141923.900573:0:14141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141923.900590:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510562816 00000100:00100000:2.0:1783141923.900593:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510562816 00000100:00100000:2.0:1783141923.900612:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141923.900617:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+9:14141:x1869759510562816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141923.900820:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+9:14141:x1869759510562816:12345-0@lo:502:llog_process_th.0 Request processed in 202us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141923.900827:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141923.900863:0:14141:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464ba538600 going to sleep for 11 seconds 00000100:00100000:2.0:1783141923.900874:0:14141:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14141:1869759510562816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783141923.900906:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141923.900923:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141923.900926:0:14141:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783141923.900931:0:14141:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783141923.900934:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783141923.900948:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff946482f2b380) 00000020:00000080:2.0:1783141923.900964:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783141923.900968:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783141923.901030:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783141923.901036:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da8996fc 00000020:00000080:2.0:1783141923.901231:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783141923.901235:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141923.901238:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141923.901239:0:14141:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783141923.901241:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141923.901244:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141923.901245:0:14141:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783141923.901248:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783141923.901254:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff946482f299c0) 00000020:00000080:2.0:1783141923.901262:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783141923.901265:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783141923.901266:0:14141:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783141923.901269:0:14141:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783141923.901274:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783141923.901317:0:14141:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464bb12d800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783141923.901328:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff946482f28000) 00000020:00000080:2.0:1783141923.901335:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783141923.901369:0:14141:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783141923.901373:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da899711 00000020:00000080:2.0:1783141923.901455:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783141923.901500:0:14141:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783141923.901521:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x279ffa91da899718 00080000:01000000:2.0:1783141923.901525:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783141923.901529:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da89971f 00010000:00010000:1.0:1783141923.981771:0:14141:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1783141923.982186:0:14141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1783141923.982363:0:14141:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783141923.983172:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9464972b3380) 00000020:00000080:1.0:1783141923.983190:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783141923.983247:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783141923.983253:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da89972d 00000020:00000080:1.0:1783141923.983906:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783141923.997169:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x279ffa91da899734 00000020:00000080:0.0:1783141923.998977:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783141923.998991:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141923.998998:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141923.999000:0:14141:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783141923.999005:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141923.999011:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141923.999013:0:14141:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783141923.999017:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783141923.999060:0:14141:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783141923.999081:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141923.999084:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141923.999086:0:14141:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783141923.999088:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783141923.999090:0:14141:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783141923.999099:0:14141:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783141923.999101:0:14141:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783141923.999103:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783141923.999105:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141923.999107:0:14141:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783141923.999109:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783141923.999113:0:14141:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783141923.999116:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141923.999118:0:14141:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783141923.999121:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783141923.999127:0:14141:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:0.0:1783141923.999150:0:14141:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783141923.999153:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783141923.999167:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9464bfed19c0) 00000020:00000080:0.0:1783141923.999183:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1783141923.999188:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783141923.999243:0:14141:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783141923.999248:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783141923.999255:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da899742 00010000:00080000:0.0:1783141923.999283:0:14141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94648b814800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:0.0:1783141923.999532:0:14141:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1783141924.000942:0:14141:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783141924.000992:0:14141:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783141924.003794:0:14141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141924.003861:0:14141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1783141924.003940:0:14141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1783141924.006036:0:14145:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783141924.006044:0:14145:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783141924.013971:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783141924.013986:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783141924.014028:0:14141:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783141924.014047:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da899749 00000100:00080000:3.0:1783141924.014057:0:14141:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783141924.014063:0:14141:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94648b814800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1783141924.014097:0:14141:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946482f4f800 x1869759510562944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141924.014545:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510562944:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783141924.014602:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759510562944 offset 0 length 520: 4 00000100:00080000:3.0:1783141924.014894:0:14141:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783141924.014968:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141924.014974:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141924.014976:0:14141:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783141924.014979:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783141924.014981:0:14141:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1783141924.014983:0:14141:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783141924.014985:0:14141:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783141924.014986:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783141924.014989:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141924.014990:0:14141:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783141924.014993:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783141924.014997:0:14141:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783141924.015001:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141924.015002:0:14141:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783141924.015004:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783141924.015008:0:14141:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.127@tcp to nid 0x20000c0a8cb7f (192.168.203.127@tcp) 00000020:01000000:3.0:1783141924.015029:0:14141:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783141924.015032:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783141924.015045:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff946496e0cd40) 00000020:00000080:3.0:1783141924.015059:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1783141924.015064:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783141924.015133:0:14141:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783141924.015138:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783141924.015144:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x279ffa91da899757 00010000:00080000:3.0:1783141924.015172:0:14141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946482f0e800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:3.0:1783141924.015382:0:14141:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1783141924.015599:0:14141:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783141924.015622:0:14141:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783141924.016165:0:14141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783141924.016231:0:14141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783141924.016318:0:14141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1783141924.018056:0:14147:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783141924.018064:0:14147:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783141924.018972:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783141924.018991:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783141924.019027:0:14141:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783141924.019045:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da89975e 00000100:00080000:2.0:1783141924.019056:0:14141:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783141924.019063:0:14141:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946482f0e800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141924.019095:0:14141:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496b27480 x1869759510563072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141924.019235:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510563072:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783141924.019364:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759510563072 offset 0 length 520: 4 00000100:00080000:2.0:1783141924.019456:0:14141:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783141924.019544:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141924.019548:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141924.019551:0:14141:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783141924.019554:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141924.019558:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141924.019560:0:14141:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783141924.019563:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783141924.019565:0:14141:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783141924.019567:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141924.019570:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141924.019571:0:14141:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783141924.019573:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783141924.019575:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141924.019577:0:14141:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783141924.019580:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783141924.019609:0:14141:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14141:1869759510563200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141924.019660:0:14141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141924.019692:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510563200 00000100:00100000:2.0:1783141924.019698:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510563200 00000100:00100000:2.0:1783141924.019740:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141924.019749:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+9:14141:x1869759510563200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141924.019978:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+9:14141:x1869759510563200:12345-0@lo:502:llog_process_th.0 Request processed in 229us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141924.019991:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141924.020027:0:14141:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464972d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1783141924.020045:0:14141:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14141:1869759510563200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783141924.020067:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783141924.020071:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141924.020072:0:14141:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783141924.020076:0:14141:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783141924.020132:0:14105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1783141924.020149:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783141924.020165:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17800/0x279ffa91da8996e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996ee expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141924.020175:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe17800/0x279ffa91da8996e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996ee expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141924.020182:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9464bb12d800 from 1 10000000:01000000:2.0:1783141924.020185:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783141924.020210:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141924.020218:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141924.020227:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141924.020240:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783141924.020265:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141924.020289:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464972d6600 going to sleep for 11 seconds 00000100:00100000:1.0:1783141924.020779:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510563328 00000100:00100000:1.0:1783141924.020785:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510563328 00000100:00100000:1.0:1783141924.020817:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783141924.020825:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+9:14105:x1869759510563328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141924.020834:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141924.020848:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da899765 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.020868:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da899765 expref: 10 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.020888:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899765 expref: 10 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.020896:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52c00, rc 0) 00000100:00100000:1.0:1783141924.020940:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+10:14105:x1869759510563328:12345-0@lo:101:mount.lustre.0 Request processed in 116us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141924.020954:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783141924.021052:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141924.021065:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.021073:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141924.021594:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563456:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783141924.021636:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141924.021661:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141924.022567:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510563456 00000100:00100000:2.0:1783141924.022576:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510563456 00000100:00100000:2.0:1783141924.022652:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783141924.022660:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+10:14105:x1869759510563456:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783141924.022679:0:14115:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783141924.022685:0:14115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783141924.022767:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+10:14105:x1869759510563456:12345-0@lo:256:mount.lustre.0 Request processed in 107us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141924.022773:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783141924.022843:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563456:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783141924.023560:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783141924.023580:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.023590:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141924.023598:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9464bb12d800 from 1 10000000:01000000:3.0:1783141924.023600:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783141924.023628:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.023635:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.023643:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141924.023672:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783141924.023709:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141924.024082:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141924.024184:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510563584 00000100:00100000:1.0:1783141924.024191:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510563584 00000100:00100000:1.0:1783141924.024223:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783141924.024231:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+10:14105:x1869759510563584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141924.024242:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141924.024254:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da899773 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.024275:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da899773 expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.024285:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899773 expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.024293:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52200, rc 0) 00000100:00100000:1.0:1783141924.024337:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14105:x1869759510563584:12345-0@lo:101:mount.lustre.0 Request processed in 105us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141924.024344:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783141924.024433:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141924.024448:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.024486:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141924.024544:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141924.024567:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141924.024590:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e240 going to sleep for 11 seconds 00000100:00100000:0.0:1783141924.024652:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510563712 00000100:00100000:0.0:1783141924.024657:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510563712 00000100:00100000:0.0:1783141924.024675:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783141924.024681:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14105:x1869759510563712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783141924.025045:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14105:x1869759510563712:12345-0@lo:501:mount.lustre.0 Request processed in 362us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141924.025052:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783141924.025131:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141924.025159:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783141924.025196:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141924.025218:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e240 going to sleep for 11 seconds 00000100:00100000:0.0:1783141924.025304:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510563840 00000100:00100000:0.0:1783141924.025309:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510563840 00000100:00100000:0.0:1783141924.025326:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141924.025331:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14105:x1869759510563840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783141924.025494:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14105:x1869759510563840:12345-0@lo:503:mount.lustre.0 Request processed in 162us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141924.025501:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783141924.025607:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510563840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783141924.025963:0:14149:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14149:1869759510563968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141924.025998:0:14149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141924.026031:0:14149:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783141924.026078:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510563968 00000100:00100000:0.0:1783141924.026082:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510563968 00000100:00100000:0.0:1783141924.026100:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141924.026106:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14149:x1869759510563968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141924.026288:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14149:x1869759510563968:12345-0@lo:502:llog_process_th.0 Request processed in 180us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141924.026295:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783141924.026416:0:14149:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14149:1869759510563968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783141924.026437:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141924.026449:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141924.026452:0:14149:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783141924.026485:0:14149:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464bb12d800 00000020:00000080:3.0:1783141924.026489:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783141924.026498:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141924.026500:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141924.026502:0:14149:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783141924.026504:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141924.026506:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141924.026508:0:14149:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783141924.026511:0:14149:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464bb12d800 00000020:00000080:3.0:1783141924.026513:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783141924.026565:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141924.026568:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141924.026570:0:14149:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783141924.026572:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141924.026575:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141924.026576:0:14149:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783141924.026580:0:14149:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9464bb12d800 00000020:00000080:3.0:1783141924.026582:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783141924.026612:0:14149:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14149:1869759510564096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783141924.026643:0:14149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141924.026662:0:14149:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141924.026725:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510564096 00000100:00100000:1.0:1783141924.026729:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510564096 00000100:00100000:1.0:1783141924.026750:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783141924.026756:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14149:x1869759510564096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783141924.026904:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14149:x1869759510564096:12345-0@lo:502:llog_process_th.0 Request processed in 147us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141924.026911:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783141924.026989:0:14149:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14149:1869759510564096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783141924.027005:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141924.027010:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141924.027011:0:14149:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783141924.027014:0:14149:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783141924.029235:0:14105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783141924.029275:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141924.029291:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.029302:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141924.029346:0:14105:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783141924.029349:0:14105:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9464bb12d800 10000000:01000000:1.0:1783141924.029352:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9464bb12d800 10000000:01000000:1.0:1783141924.029356:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783141924.029362:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9464bb12d800 from 1 10000000:01000000:1.0:1783141924.029364:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783141924.029398:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da899781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.029406:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da899781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.029416:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da899781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141924.029437:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510564224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783141924.029518:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141924.029557:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff946383c649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141924.029579:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510564224 00000100:00100000:1.0:1783141924.029584:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510564224 00000100:00100000:1.0:1783141924.029616:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783141924.029624:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14105:x1869759510564224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141924.029635:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141924.029651:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946496f52a00/0x279ffa91da899788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da899781 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.029672:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f52a00/0x279ffa91da899788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da899781 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.029682:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946496f52a00/0x279ffa91da899788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899781 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.029691:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52a00, rc 0) 00000100:00100000:1.0:1783141924.029725:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14105:x1869759510564224:12345-0@lo:101:mount.lustre.0 Request processed in 102us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141924.029731:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783141924.029775:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510564224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141924.029788:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da899781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899788 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.029797:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da899781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da899788 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141924.029840:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510564352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141924.029866:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141924.029892:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff946383c649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141924.029906:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510564352 00000100:00100000:1.0:1783141924.029909:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510564352 00000100:00100000:1.0:1783141924.029924:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783141924.029929:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14105:x1869759510564352:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141924.031244:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14105:x1869759510564352:12345-0@lo:501:mount.lustre.0 Request processed in 1307us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141924.031260:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783141924.035608:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510564352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141924.035668:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510564480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783141924.035746:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141924.035780:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141924.035902:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510564480 00000100:00100000:1.0:1783141924.035908:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510564480 00000100:00100000:1.0:1783141924.035961:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783141924.035972:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14105:x1869759510564480:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783141924.036148:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14105:x1869759510564480:12345-0@lo:503:mount.lustre.0 Request processed in 177us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141924.036156:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783141924.036250:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510564480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783141924.054081:0:14153:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14153:1869759510564608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141924.054158:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141924.055759:0:14153:0:(client.c:2701:ptlrpc_set_wait()) set ffff946482f183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141924.056063:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510564608 00000100:00100000:2.0:1783141924.056072:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510564608 00000100:00100000:2.0:1783141924.056123:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783141924.056131:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfeccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14153:x1869759510564608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783141924.056574:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfeccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14153:x1869759510564608:12345-0@lo:502:llog_process_th.0 Request processed in 442us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141924.056583:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141924.058224:0:14153:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14153:1869759510564608:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783141924.058301:0:14153:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783141924.058316:0:14153:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9464bfed4d40) 00000020:00000080:0.0:1783141924.058337:0:14153:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1783141924.058651:0:14153:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464bb12d800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783141924.058656:0:14153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9464bb12d800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783141924.058658:0:14153:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9464bb12d800 4 00010000:00080000:0.0:1783141924.058691:0:14153:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946497224000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.127@tcp at head 00010000:00010000:0.0:1783141924.061072:0:14153:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1783141924.061165:0:14153:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783141924.061199:0:14153:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783141924.061211:0:14153:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x279ffa91da899796 00000100:00080000:0.0:1783141924.061220:0:14153:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783141924.061225:0:14153:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff946497224000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1783141924.061255:0:14153:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9464baac8a80 x1869759510564736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783141924.061279:0:14153:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783141924.061312:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510564736:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783141924.061367:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141924.061582:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510564736 00000100:00100000:2.0:1783141924.061590:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510564736 00000100:00100000:2.0:1783141924.061621:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141924.061628:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1869759510564736:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783141924.061672:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1869759510564736:12345-0@lo:38:llog_process_th.0 Request processed in 44us (305us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783141924.061679:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141924.061753:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783141924.061760:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946497224000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783141924.061764:0:3304:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783141924.061767:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510564736:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783141924.061866:0:14153:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14153:1869759510564864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141924.063310:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141924.063358:0:14153:0:(client.c:2701:ptlrpc_set_wait()) set ffff946482f183c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141924.063384:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510564864 00000100:00100000:0.0:1783141924.063396:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510564864 00000100:00100000:0.0:1783141924.063438:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141924.063446:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14153:x1869759510564864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783141924.063696:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14153:x1869759510564864:12345-0@lo:502:llog_process_th.0 Request processed in 250us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141924.063704:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141924.063756:0:14153:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14153:1869759510564864:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783141924.063785:0:14153:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783141924.064001:0:14105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783141924.064024:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783141924.064050:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da899781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899788 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141924.064072:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946496f53400/0x279ffa91da899781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899788 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783141924.064116:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783141924.064118:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783141924.064119:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141924.064120:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141924.064122:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141924.064123:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141924.064125:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783141924.064126:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783141924.064127:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141924.064129:0:14105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783141924.064132:0:14105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783141924.064135:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783141924.064136:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783141924.064137:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141924.064138:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141924.064139:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141924.064140:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141924.064141:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783141924.064142:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783141924.064143:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141924.064144:0:14105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783141924.064161:0:14105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783141924.064176:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510564992:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783141924.064214:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141924.064237:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464972d6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783141924.064255:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510564992 00000100:00100000:2.0:1783141924.064259:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510564992 00000100:00100000:2.0:1783141924.064283:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783141924.064289:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14105:x1869759510564992:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783141924.064310:0:14117:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783141924.064330:0:14117:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783141924.111376:0:14117:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783141924.111391:0:14117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783141924.111508:0:14139:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783141924.111514:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783141924.111534:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.111552:0:14139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899765 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.111561:0:14139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.111597:0:14139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da899765 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.111610:0:14139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da899765 expref: 12 pid: 14116 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141924.111624:0:14139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869759510565120:0@lo:104: 00000100:00100000:3.0:1783141924.111679:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141924.111750:0:14139:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141924.116760:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510565120 00000100:00100000:1.0:1783141924.116784:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510565120 00000100:00100000:1.0:1783141924.116839:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141924.116848:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:14139:x1869759510565120:12345-0@lo:104: 00010000:00010000:1.0:1783141924.116866:0:14106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.116968:0:14106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783141924.116974:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:14139:x1869759510565120:12345-0@lo:104: Request processed in 127us (5295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141924.116981:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783141924.117001:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141924.117006:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117013:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0800 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141924.117017:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117042:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141924.117049:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141924.117054:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141924.117086:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117091:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141924.117119:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117127:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464b25a0800/0x279ffa91da899765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89976c expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141924.117271:0:14139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869759510565120:0@lo:104: 00010000:00010000:3.0:1783141924.117293:0:14139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117351:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141924.117353:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141924.117355:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141924.117511:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3307:1869759510565248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141924.117552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141924.117676:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510565248 00000100:00100000:1.0:1783141924.117681:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510565248 00010000:00010000:1.0:1783141924.117698:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da899765 expref: 13 pid: 14116 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141924.117724:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783141924.117731:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+13:3307:x1869759510565248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783141924.117741:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141924.117746:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da899765 expref: 13 pid: 14116 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117763:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da899765 expref: 13 pid: 14116 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117928:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946496f52c00/0x279ffa91da89976c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da899765 expref: 13 pid: 14116 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117943:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117951:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783141924.117965:0:14108:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006451951s 00010000:00010000:1.0:1783141924.117969:0:14108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117976:0:14108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117982:0:14108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117988:0:14108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.117993:0:14108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141924.117997:0:14108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.118003:0:14108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.118030:0:14108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141924.118039:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141924.118075:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:3307:x1869759510565248:12345-0@lo:103:ldlm_bl.0 Request processed in 344us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141924.118082:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783141924.118148:0:14139:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.118167:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141924.118174:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464bfe17c00/0x279ffa91da89979d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141924.118350:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3307:1869759510565248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141924.135364:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14105:x1869759510564992:12345-0@lo:253:mount.lustre.0 Request processed in 71066us (71139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141924.135379:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783141924.135512:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14105:1869759510564992:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783141924.135527:0:14105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783141924.135530:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783141924.135532:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783141924.135533:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141924.135534:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141924.135535:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141924.135537:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141924.135538:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783141924.135539:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783141924.135541:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141924.135542:0:14105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783141924.135558:0:14105:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783141924.147327:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1783141924.147533:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783141924.147829:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1783141924.148008:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783141924.151545:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141924.151734:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1783141924.161314:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141924.161894:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1783141924.162604:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141924.162864:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1783141924.163257:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141924.163422:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1783141924.202515:0:14105:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1783141924.203016:0:14105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1783141924.205601:0:14162:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1783141924.205666:0:14162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1783141924.206141:0:14105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783141924.206258:0:14105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783141924.207698:0:14105:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783141924.207717:0:14105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:3.0:1783141924.207860:0:14161:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1783141924.207865:0:14161:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1783141924.208019:0:14105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141924.209725:0:14162:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783141924.209795:0:14162:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783141924.209799:0:14162:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1783141924.211544:0:14105:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783141924.212257:0:14105:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783141924.212287:0:14105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783141924.212749:0:14105:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1783141924.214385:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1783141924.219240:0:14105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1783141924.246482:0:14105:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783141924.246522:0:14105:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa4c302a1b988 00100000:10000000:1.0:1783141924.246530:0:14105:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783141924.247346:0:14105:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783141924.247363:0:14105:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783141924.247377:0:14105:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783141924.247403:0:14105:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1783141924.763606:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783141925.083811:0:14155:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141925.083821:0:14155:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141925.084257:0:14155:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1783141925.084265:0:14155:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1783141925.091300:0:14119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783141925.091307:0:14119:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9464bb12d800 from 6 10000000:01000000:2.0:1783141925.091311:0:14119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783141925.091353:0:14119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141925.091367:0:14119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141925.091378:0:14119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141925.091402:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510565376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783141925.091484:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141925.091525:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648682e180 going to sleep for 11 seconds 00000100:00100000:1.0:1783141925.091716:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510565376 00000100:00100000:1.0:1783141925.091734:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510565376 00000100:00100000:1.0:1783141925.091796:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783141925.091805:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14119:x1869759510565376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141925.091819:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141925.091834:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8997a4 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141925.091856:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8997a4 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141925.091866:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8997a4 expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141925.091884:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52800, rc 0) 00000100:00100000:1.0:1783141925.091922:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14119:x1869759510565376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141925.091930:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783141925.097114:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510565376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141925.097148:0:14119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141925.097161:0:14119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141925.097224:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510565504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783141925.097283:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141925.098070:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648682e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783141925.100168:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510565504 00000100:00100000:0.0:1783141925.100180:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510565504 00000100:00100000:0.0:1783141925.100235:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783141925.100244:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14119:x1869759510565504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783141925.100267:0:14117:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783141925.100287:0:14117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783141925.100290:0:14117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783141925.100695:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14119:x1869759510565504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 450us (3410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141925.100704:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783141925.100792:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510565504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783141925.100840:0:14119:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783141925.100850:0:14119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141925.100861:0:14119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141925.786717:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783141926.106649:0:14155:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783141926.106658:0:14155:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141926.106691:0:14155:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1783141926.106698:0:14155:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783141926.814528:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141927.834690:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141928.287559:0:14405:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783141928.858591:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783141929.500991:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783141929.500999:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783141929.501002:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783141929.501005:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783141929.501008:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783141929.501012:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783141929.501016:0:8:0:(import.c:65:import_set_state_nolock()) ffff946497224000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783141929.501034:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1783141929.501044:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff946497224000 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:0.0:1783141929.501059:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3307:1869759510565632:0@lo:400:kworker.0 00000100:00100000:3.0:1783141929.501076:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946482f4c000 x1869759510565760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783141929.501118:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510565760:0@lo:38:kworker.0 00000100:00100000:3.0:1783141929.501183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141929.501281:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510565760 00000100:00100000:0.0:1783141929.501287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141929.501291:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510565760 00000100:00100000:3.0:1783141929.501338:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141929.501353:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510565632 00000100:00100000:0.0:1783141929.501358:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510565632 00000100:00100000:3.0:1783141929.501368:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1869759510565760:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783141929.501399:0:14125:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000100:00100000:0.0:1783141929.501404:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783141929.501414:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:3307:x1869759510565632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141929.501490:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:3307:x1869759510565632:12345-0@lo:400:kworker.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141929.501498:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783141929.501553:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3307:1869759510565632:0@lo:400:kworker.0 00000020:00000080:3.0:1783141929.501627:0:14125:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x279ffa91da8997b2 00000004:00100000:3.0:1783141929.501646:0:14125:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783141929.501788:0:14125:0:(import.c:65:import_set_state_nolock()) ffff9464850db000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783141929.501848:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1869759510565760:12345-0@lo:38:kworker.0 Request processed in 481us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141929.501856:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783141929.501887:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946482f4c000 x1869759510565760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783141929.501917:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783141929.501926:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783141929.501932:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783141929.501935:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946497224000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783141929.501942:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1869759510565760:0@lo:38:kworker.0 00010000:00010000:1.0:1783141929.883004:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141930.907258:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783141930.924066:0:14556:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf933dcc0 20000000:00000080:3.0:1783141930.924083:0:14556:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9464bbdbe400 uarg=0000000000000000 20000000:01000000:3.0:1783141930.924117:0:14556:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783141930.924124:0:14556:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783141930.924128:0:14556:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783141930.933449:0:14557:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1783141930.933688:0:14556:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783141930.948188:0:14556:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783141930.948219:0:14556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141930.948239:0:14556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899773 expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141930.948248:0:14556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141930.949053:0:14556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da899773 expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141930.949076:0:14556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da899773 expref: 11 pid: 14116 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141930.949091:0:14556:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14556:1869759510565888:0@lo:104: 00000100:00100000:1.0:1783141930.949153:0:14556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141930.949209:0:14556:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464851786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141930.950126:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510565888 00000100:00100000:0.0:1783141930.950137:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510565888 00000100:00100000:0.0:1783141930.950192:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141930.950201:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:14556:x1869759510565888:12345-0@lo:104: 00010000:00010000:0.0:1783141930.950217:0:14107:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.950300:0:14107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783141930.950305:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:14556:x1869759510565888:12345-0@lo:104: Request processed in 106us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141930.950312:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1783141930.950334:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141930.950339:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.950418:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16000 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:0.0:1783141930.950423:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.950433:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783141930.950456:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141930.950479:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783141930.950513:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.950519:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783141930.950538:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.950545:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464bfe16000/0x279ffa91da899773 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89977a expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.950564:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141930.950565:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141930.950567:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141930.950591:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510566016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141930.950624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141930.950686:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510566016 00000100:00100000:0.0:1783141930.950690:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510566016 00010000:00010000:0.0:1783141930.950705:0:14109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da899773 expref: 12 pid: 14116 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141930.950725:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141930.951509:0:14556:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14556:1869759510565888:0@lo:104: 00010000:00010000:3.0:1783141930.951545:0:14556:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141930.951849:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:3305:x1869759510566016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141930.952426:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141930.952437:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da899773 expref: 12 pid: 14116 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952483:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da899773 expref: 12 pid: 14116 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952503:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946496f52200/0x279ffa91da89977a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da899773 expref: 12 pid: 14116 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952521:0:14109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952528:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952544:0:14109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952552:0:14109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952558:0:14109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952565:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952571:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52e00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141930.952576:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952584:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952619:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141930.952630:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141930.952696:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:3305:x1869759510566016:12345-0@lo:103:ldlm_bl.0 Request processed in 855us (2070us total) trans 0 rc 0/0 00010000:00010000:3.0:1783141930.952719:0:14556:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141930.952733:0:14556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141930.952742:0:14556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946496f52e00/0x279ffa91da8997b9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141930.952791:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510566016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783141930.958446:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783141931.941202:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783141932.701344:0:14119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783141932.701352:0:14119:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9464bb12d800 from 10 10000000:01000000:0.0:1783141932.701357:0:14119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141932.701405:0:14119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141932.701416:0:14119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141932.701426:0:14119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141932.701452:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510566144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783141932.701538:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141932.701584:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487666540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141932.702025:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510566144 00000100:00100000:2.0:1783141932.702033:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510566144 00000100:00100000:2.0:1783141932.702146:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783141932.702158:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+11:14119:x1869759510566144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141932.702173:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141932.702188:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8997c0 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141932.702212:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8997c0 expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141932.702236:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8997c0 expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141932.702245:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0e00, rc 0) 00000100:00100000:2.0:1783141932.702298:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14119:x1869759510566144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141932.702305:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783141932.702377:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510566144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141932.702392:0:14119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141932.702401:0:14119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141932.702489:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510566272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141932.702516:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141932.702827:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487666540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141932.702988:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510566272 00000100:00100000:3.0:1783141932.702994:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510566272 00000100:00100000:3.0:1783141932.703025:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783141932.703032:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14119:x1869759510566272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141932.703280:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14119:x1869759510566272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141932.703287:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783141932.704579:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510566272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141932.704639:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510566400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141932.704692:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141932.704776:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487666540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141932.704796:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510566400 00000100:00100000:0.0:1783141932.704801:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510566400 00000100:00100000:0.0:1783141932.704839:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783141932.704847:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14119:x1869759510566400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141932.705165:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14119:x1869759510566400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141932.705173:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783141932.705217:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510566400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783141932.707556:0:14635:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783141932.707626:0:14119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783141932.707645:0:14119:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783141932.707657:0:14119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141932.707669:0:14119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141932.955549:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141933.980837:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783141934.619765:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783141934.619773:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783141934.619776:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783141934.619780:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783141934.619843:0:3304:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141924/real 1783141924] req@ffff946496b27480 x1869759510563072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783141934 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141934.619877:0:3304:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946496b27480 x1869759510563072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783141934 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141934.619887:0:3304:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141924/real 1783141924] req@ffff946482f4f800 x1869759510562944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783141934 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141934.620021:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510566656:0@lo:400:kworker.0 00000100:00100000:0.0:1783141934.620107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141934.620218:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510566656 00000100:00100000:0.0:1783141934.620229:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510566656 00000100:00100000:0.0:1783141934.620284:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141934.620295:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510566656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141934.620355:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510566656:12345-0@lo:400:kworker.0 Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141934.620364:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141934.620723:0:3304:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946482f4f800 x1869759510562944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783141934 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783141934.620744:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946482f0e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783141934.620761:0:3304:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783141934.620766:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510563072:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783141934.620785:0:3304:0:(import.c:65:import_set_state_nolock()) ffff94648b814800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783141934.620790:0:3304:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783141934.620794:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510562944:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783141934.620837:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141934.620848:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510566528:0@lo:400:kworker.0 00000100:00100000:2.0:1783141934.620892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783141934.621178:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783141934.621184:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783141934.621186:0:8:0:(import.c:65:import_set_state_nolock()) ffff94648b814800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141934.621191:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1783141934.621196:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783141934.621201:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94648b814800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141934.622694:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496b27480 x1869759510566784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783141934.622726:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783141934.622731:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783141934.622734:0:8:0:(import.c:65:import_set_state_nolock()) ffff946482f0e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141934.622739:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1783141934.622744:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783141934.622752:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946482f0e800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141934.622775:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496b24000 x1869759510566912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783141934.622829:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510566784:0@lo:8:kworker.0 00000400:00000100:2.0:1783141934.623346:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759510566784 offset 0 length 520: 4 00000100:00100000:0.0:1783141934.623497:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510566528 00000100:00100000:0.0:1783141934.623509:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510566528 00000100:00100000:0.0:1783141934.623585:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783141934.623596:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:3305:x1869759510566528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141934.623685:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:3305:x1869759510566528:12345-0@lo:400:kworker.0 Request processed in 87us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141934.623693:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783141934.623781:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946496b25f80 x1869759510566656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141934.623788:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510566912:0@lo:8:kworker.0 00000100:00100000:0.0:1783141934.623820:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510566656:0@lo:400:kworker.0 00000400:00000100:2.0:1783141934.623851:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869759510566912 offset 0 length 520: 4 00000100:00100000:2.0:1783141934.623925:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510566528:0@lo:400:kworker.0 00000020:01000004:3.0:1783141934.861874:0:14757:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783141934.861888:0:14757:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783141934.861996:0:14757:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff946496822800 00000020:01000004:3.0:1783141934.862010:0:14757:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783141934.862023:0:14757:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783141934.862036:0:14757:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff946496e08000) 00000020:00000080:3.0:1783141934.862051:0:14757:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783141934.877956:0:14757:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783141934.878243:0:14757:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1783141934.879044:0:14757:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783141934.879237:0:14757:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1783141934.879400:0:14757:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1783141934.879773:0:14757:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 521: rc = 0 00100000:10000000:3.0:1783141934.879887:0:14757:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 521: rc = 0 00100000:10000000:3.0:1783141934.879988:0:14757:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 521: rc = 0 00100000:10000000:3.0:1783141934.880522:0:14757:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 771: rc = 0 00100000:10000000:3.0:1783141934.880785:0:14757:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:3.0:1783141934.881053:0:14757:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:3.0:1783141934.881301:0:14757:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 771: rc = 0 00100000:10000000:3.0:1783141934.881630:0:14757:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 771: rc = 0 00100000:10000000:3.0:1783141934.881903:0:14757:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00000020:00000080:3.0:1783141934.882430:0:14757:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783141934.882446:0:14757:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783141934.882455:0:14757:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x279ffa91da8997d5 00000020:01000004:3.0:1783141934.882484:0:14757:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1783141934.882505:0:14757:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783141934.882509:0:14757:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783141934.882514:0:14757:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783141934.882519:0:14757:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783141934.882530:0:14757:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff946496e0b380) 00000020:00000080:3.0:1783141934.882539:0:14757:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1783141934.883755:0:14757:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783141934.886955:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783141934.886964:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783141934.887718:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783141934.887727:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783141934.887986:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783141934.887993:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783141934.889259:0:14757:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783141934.889417:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783141934.889422:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783141934.892049:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783141934.892062:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783141934.909978:0:14757:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783141934.910202:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783141934.910209:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783141934.912208:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783141934.912221:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783141934.914779:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783141934.914794:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783141934.920747:0:14757:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783141934.920938:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783141934.920952:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783141934.922194:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783141934.922205:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1783141934.972917:0:14757:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783141934.973219:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1783141934.973228:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783141934.977311:0:14757:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783141934.977324:0:14757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1783141934.979243:0:14757:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1783141934.979270:0:14757:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1783141934.979276:0:14757:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783141935.000622:0:14757:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783141935.000664:0:14757:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.127@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783141935.000669:0:14757:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783141935.000671:0:14757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783141935.000672:0:14757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141935.000673:0:14757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141935.000674:0:14757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141935.000676:0:14757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141935.000677:0:14757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141935.000679:0:14757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141935.000680:0:14757:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783141935.000684:0:14757:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783141935.000686:0:14757:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783141935.000687:0:14757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783141935.000689:0:14757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141935.000690:0:14757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141935.000696:0:14757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141935.000697:0:14757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141935.000698:0:14757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141935.000699:0:14757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141935.000700:0:14757:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783141935.000736:0:14757:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783141935.000755:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783141935.004009:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783141935.004139:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141935.004322:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464864edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783141935.010936:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510567040 00000100:00100000:1.0:1783141935.010951:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510567040 00000100:00100000:1.0:1783141935.011004:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783141935.011014:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14757:x1869759510567040:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783141935.011051:0:14116:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783141935.011055:0:14116:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783141935.011058:0:14116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783141935.032027:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14757:x1869759510567040:12345-0@lo:253:mount.lustre.0 Request processed in 21005us (28015us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141935.032042:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783141935.032220:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783141935.032235:0:14757:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783141935.032238:0:14757:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783141935.032240:0:14757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783141935.032241:0:14757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141935.032242:0:14757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141935.032243:0:14757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141935.032244:0:14757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141935.032246:0:14757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141935.032248:0:14757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141935.032249:0:14757:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783141935.032271:0:14757:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946496822800 from lustre-OST0000 10000000:01000000:2.0:1783141935.032297:0:14757:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783141935.032300:0:14757:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783141935.032307:0:14757:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9464bfed0000 local copy 00010000:00010000:2.0:1783141935.032318:0:14757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141935.032570:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783141935.032604:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.032687:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff946493cda900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141935.035882:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510567168 00000100:00100000:3.0:1783141935.035897:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510567168 00000100:00100000:3.0:1783141935.036004:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783141935.036012:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14757:x1869759510567168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141935.036361:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14757:x1869759510567168:12345-0@lo:501:mount.lustre.0 Request processed in 349us (3755us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783141935.036369:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783141935.036446:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567168:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783141935.036484:0:14757:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783141935.036726:0:14757:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783141935.036736:0:14757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.036746:0:14757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141935.036774:0:14757:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946496822800 10000000:01000000:2.0:1783141935.036779:0:14757:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783141935.036784:0:14757:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9464bfed0000 10000000:01000000:2.0:1783141935.036786:0:14757:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783141935.036789:0:14757:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9464bfed0000 from 1 10000000:01000000:2.0:1783141935.036792:0:14757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783141935.036835:0:14757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a0400/0x279ffa91da8997e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.036844:0:14757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464b25a0400/0x279ffa91da8997e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.036853:0:14757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464b25a0400/0x279ffa91da8997e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141935.036873:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783141935.036908:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.036949:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff946493cda900 going to sleep for 11 seconds 00000100:00100000:1.0:1783141935.037019:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510567296 00000100:00100000:1.0:1783141935.037024:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510567296 00000100:00100000:1.0:1783141935.037061:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783141935.037068:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+12:14757:x1869759510567296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141935.037078:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141935.037091:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946496f52e00/0x279ffa91da8997ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8997e3 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.037112:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f52e00/0x279ffa91da8997ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8997e3 expref: 13 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.037122:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946496f52e00/0x279ffa91da8997ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8997e3 expref: 13 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.037131:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52e00, rc 0) 00000100:00100000:1.0:1783141935.037166:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+13:14757:x1869759510567296:12345-0@lo:101:mount.lustre.0 Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141935.037172:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783141935.037289:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141935.037301:0:14757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464b25a0400/0x279ffa91da8997e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997ea expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.037310:0:14757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464b25a0400/0x279ffa91da8997e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8997ea expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141935.037331:0:14757:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783141935.037346:0:14757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a0400/0x279ffa91da8997e3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997ea expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.037353:0:14757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464b25a0400/0x279ffa91da8997e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997ea expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141935.037359:0:14757:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783141935.037362:0:14757:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783141935.037367:0:14757:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783141935.037369:0:14757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783141935.037381:0:14757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a1000/0x279ffa91da8997f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.037388:0:14757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464b25a1000/0x279ffa91da8997f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.037396:0:14757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464b25a1000/0x279ffa91da8997f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141935.037408:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783141935.037432:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.037576:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff946493cda900 going to sleep for 11 seconds 00000100:00100000:3.0:1783141935.037698:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510567424 00000100:00100000:3.0:1783141935.037702:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510567424 00000100:00100000:3.0:1783141935.037735:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783141935.037742:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+13:14757:x1869759510567424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141935.037749:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141935.037756:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464bfe16600/0x279ffa91da8997f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8997f1 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.037769:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464bfe16600/0x279ffa91da8997f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8997f1 expref: 14 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.037784:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464bfe16600/0x279ffa91da8997f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8997f1 expref: 14 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.037790:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16600, rc 0) 00000100:00100000:3.0:1783141935.037914:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510567424:12345-0@lo:101:mount.lustre.0 Request processed in 172us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141935.037920:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783141935.037976:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141935.037986:0:14757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464b25a1000/0x279ffa91da8997f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997f8 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.037993:0:14757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464b25a1000/0x279ffa91da8997f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8997f8 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141935.038635:0:14757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783141935.040058:0:14757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141935.040355:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783141935.040400:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783141935.040437:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783141935.040526:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783141935.040563:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783141935.040734:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783141935.040818:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783141935.040826:0:14757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783141935.040913:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baacb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783141935.040972:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141935.041056:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141935.041159:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510567552 00000100:00100000:2.0:1783141935.041165:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510567552 00000100:00100000:2.0:1783141935.041240:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783141935.041249:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510567552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783141935.041728:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510567552:12345-0@lo:501:mount.lustre.0 Request processed in 479us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141935.041737:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783141935.041845:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baacb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783141935.041883:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baacb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783141935.041923:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141935.041995:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141935.042034:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510567680 00000100:00100000:2.0:1783141935.042039:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510567680 00000100:00100000:2.0:1783141935.042103:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783141935.042110:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510567680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783141935.042386:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510567680:12345-0@lo:503:mount.lustre.0 Request processed in 276us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141935.042393:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783141935.042479:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baacb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567680:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783141935.043088:0:14757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783141935.043146:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baacb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783141935.043189:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141935.045090:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141935.046308:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510567808 00000100:00100000:1.0:1783141935.046319:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510567808 00000100:00100000:0.0:1783141935.046619:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783141935.046628:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510567808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783141935.047905:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baacb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783141935.048119:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510567808:12345-0@lo:502:mount.lustre.0 Request processed in 1215us (4653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141935.048130:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000040:00080000:1.0:1783141935.048599:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783141935.048657:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783141935.048691:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783141935.048741:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783141935.048778:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783141935.048836:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783141935.049000:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783141935.049037:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783141935.049123:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1783141935.049170:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1783141935.049207:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1783141935.049602:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1783141935.049653:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baacaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783141935.049719:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141935.049808:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141935.049842:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510567936 00000100:00100000:1.0:1783141935.049849:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510567936 00000100:00100000:1.0:1783141935.050145:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783141935.050157:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510567936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783141935.050903:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510567936:12345-0@lo:502:mount.lustre.0 Request processed in 746us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141935.050914:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783141935.054143:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baacaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510567936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783141935.054298:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1783141935.054391:0:14757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1783141935.056351:0:14771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783141935.056364:0:14771:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783141935.056373:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141935.056375:0:14771:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783141935.056381:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783141935.056399:0:14771:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff946482f2cd40) 00000020:00000080:2.0:1783141935.056420:0:14771:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783141935.056425:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783141935.056519:0:14771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946496822800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783141935.056526:0:14771:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783141935.056532:0:14771:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x279ffa91da899806 00010000:00010000:2.0:1783141935.060851:0:14771:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1783141935.061645:0:14771:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1783141935.064253:0:14771:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1783141935.066927:0:14771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783141935.066941:0:14771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141935.066947:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.066949:0:14771:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783141935.066954:0:14771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783141935.066956:0:14771:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1783141935.066957:0:14771:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783141935.066959:0:14771:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783141935.066960:0:14771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783141935.066963:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.066964:0:14771:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783141935.066966:0:14771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141935.066968:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.066970:0:14771:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783141935.066972:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783141935.066974:0:14771:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783141935.066975:0:14771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141935.066977:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.066978:0:14771:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783141935.066980:0:14771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141935.066982:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.066983:0:14771:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783141935.066985:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783141935.067046:0:14771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141935.067057:0:14771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.067059:0:14771:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783141935.067063:0:14771:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1783141935.068129:0:14757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783141935.068162:0:14757:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783141935.068188:0:14757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a1000/0x279ffa91da8997f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997f8 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.068200:0:14757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464b25a1000/0x279ffa91da8997f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8997f8 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141935.068208:0:14757:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946496822800 from 1 10000000:01000000:0.0:1783141935.068211:0:14757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783141935.068247:0:14757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.068254:0:14757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.068264:0:14757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141935.068285:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783141935.068357:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141935.068413:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783141935.068498:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510568064 00000100:00100000:3.0:1783141935.068506:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510568064 00000100:00100000:3.0:1783141935.068560:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783141935.068569:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+14:14757:x1869759510568064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783141935.068584:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141935.068597:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89980d expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.068620:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89980d expref: 15 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.068631:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89980d expref: 15 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141935.068640:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17c00, rc 0) 00000100:00100000:3.0:1783141935.068675:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568064:12345-0@lo:101:mount.lustre.0 Request processed in 107us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141935.068681:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783141935.069266:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783141935.069282:0:14757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.069290:0:14757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783141935.069781:0:14757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783141935.071985:0:14757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783141935.074531:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783141935.074654:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783141935.074826:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783141935.074850:0:14757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1783141935.075195:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783141935.075270:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141935.075345:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783141935.075502:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510568192 00000100:00100000:3.0:1783141935.075510:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510568192 00000100:00100000:3.0:1783141935.075557:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783141935.075566:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141935.075793:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568192:12345-0@lo:501:mount.lustre.0 Request processed in 227us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141935.075816:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783141935.076201:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783141935.076237:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783141935.076281:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141935.076315:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783141935.076412:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510568320 00000100:00100000:3.0:1783141935.076424:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510568320 00000100:00100000:3.0:1783141935.076487:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783141935.076494:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568320:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783141935.076656:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568320:12345-0@lo:503:mount.lustre.0 Request processed in 162us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141935.076663:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783141935.076849:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568320:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783141935.080546:0:14757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783141935.080652:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783141935.080740:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.080781:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141935.082524:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510568448 00000100:00100000:3.0:1783141935.082537:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510568448 00000100:00100000:3.0:1783141935.082589:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783141935.082598:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783141935.082838:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568448:12345-0@lo:502:mount.lustre.0 Request processed in 240us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141935.082846:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783141935.083642:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783141935.084332:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783141935.084560:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783141935.084625:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783141935.084658:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783141935.084684:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783141935.084736:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783141935.084772:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783141935.084816:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1783141935.084860:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783141935.086515:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.086560:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141935.086662:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510568576 00000100:00100000:1.0:1783141935.086670:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510568576 00000100:00100000:1.0:1783141935.086815:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783141935.086825:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783141935.087038:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568576:12345-0@lo:502:mount.lustre.0 Request processed in 212us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141935.087047:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783141935.087451:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783141935.087670:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783141935.087684:0:14757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1783141935.091593:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141935.091606:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.091608:0:14775:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783141935.091616:0:14775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff946496822800 00000020:00000080:3.0:1783141935.091618:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783141935.091626:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141935.091628:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.091629:0:14775:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783141935.091632:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141935.091634:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.091635:0:14775:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783141935.091639:0:14775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff946496822800 00000020:00000080:3.0:1783141935.091641:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783141935.091693:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141935.091695:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.091697:0:14775:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783141935.091699:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141935.091709:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.091710:0:14775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783141935.091714:0:14775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946496822800 00000020:00000080:3.0:1783141935.091716:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783141935.091747:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141935.091750:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141935.091751:0:14775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783141935.091754:0:14775:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1783141935.092324:0:14757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783141935.092441:0:14757:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783141935.092491:0:14757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.092503:0:14757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141935.092546:0:14757:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783141935.092549:0:14757:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946496822800 10000000:01000000:2.0:1783141935.092552:0:14757:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946496822800 10000000:01000000:2.0:1783141935.092555:0:14757:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783141935.092560:0:14757:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff946496822800 from 1 10000000:01000000:2.0:1783141935.092562:0:14757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783141935.092593:0:14757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a0600/0x279ffa91da89981b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.092601:0:14757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464b25a0600/0x279ffa91da89981b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.092611:0:14757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464b25a0600/0x279ffa91da89981b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141935.092632:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783141935.092686:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.092719:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510568704 00000100:00100000:2.0:1783141935.092726:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510568704 00000100:00100000:2.0:1783141935.092758:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783141935.092765:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510568704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141935.092778:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141935.092788:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a1400/0x279ffa91da899822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89981b expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.092834:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a1400/0x279ffa91da899822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89981b expref: 16 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.092843:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a1400/0x279ffa91da899822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89981b expref: 16 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.092850:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1400, rc 0) 00000100:00100000:2.0:1783141935.095572:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510568704:12345-0@lo:101:mount.lustre.0 Request processed in 2797us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141935.095585:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783141935.095654:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141935.095681:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141935.095704:0:14757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464b25a0600/0x279ffa91da89981b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899822 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.095717:0:14757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464b25a0600/0x279ffa91da89981b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da899822 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141935.096280:0:14757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1783141935.104952:0:14757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141935.105273:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783141935.105322:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783141935.105355:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783141935.105412:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783141935.105448:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783141935.105519:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783141935.105575:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783141935.105608:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783141935.105664:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783141935.105695:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783141935.105722:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783141935.105764:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783141935.110409:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783141935.110531:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783141935.110601:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783141935.110633:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783141935.110659:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783141935.110699:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783141935.110731:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783141935.110762:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783141935.110820:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783141935.110857:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783141935.110928:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783141935.110978:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783141935.111014:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1783141935.111050:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1783141935.111099:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1783141935.111134:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1783141935.111222:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1783141935.111230:0:14757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1783141935.111989:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783141935.112052:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.112104:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141935.112189:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510568832 00000100:00100000:1.0:1783141935.112196:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510568832 00000100:00100000:1.0:1783141935.112244:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783141935.112253:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510568832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141935.112523:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510568832:12345-0@lo:501:mount.lustre.0 Request processed in 270us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141935.112530:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783141935.113059:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783141935.113101:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783141935.113141:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.113167:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141935.113556:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510568960 00000100:00100000:1.0:1783141935.113568:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510568960 00000100:00100000:1.0:1783141935.113610:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783141935.113617:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510568960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783141935.113776:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510568960:12345-0@lo:503:mount.lustre.0 Request processed in 159us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141935.113784:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783141935.114177:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510568960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783141935.114753:0:14757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783141935.114839:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510569088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783141935.119960:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.120007:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510569088 00000100:00100000:2.0:1783141935.120015:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510569088 00000100:00100000:2.0:1783141935.120065:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783141935.120075:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510569088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783141935.120310:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510569088:12345-0@lo:502:mount.lustre.0 Request processed in 236us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141935.120317:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783141935.120373:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141935.120396:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510569088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783141935.120692:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783141935.120743:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783141935.120779:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783141935.123321:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783141935.123401:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783141935.123473:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783141935.123529:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783141935.123559:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783141935.123618:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783141935.123654:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783141935.123683:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783141935.123727:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783141935.123763:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783141935.123812:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783141935.123865:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783141935.124042:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783141935.124089:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783141935.124138:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783141935.124176:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783141935.124210:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783141935.124273:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783141935.124365:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783141935.124411:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783141935.124454:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783141935.124507:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1783141935.124535:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1783141935.124575:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1783141935.124604:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1783141935.124630:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1783141935.124667:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1783141935.124695:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1783141935.124722:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1783141935.124749:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1783141935.124790:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1783141935.124835:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1783141935.126433:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1783141935.126523:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1783141935.126552:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1783141935.126610:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1783141935.126643:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1783141935.126692:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510569216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783141935.126765:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.126821:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510569216 00000100:00100000:2.0:1783141935.126828:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510569216 00000100:00100000:2.0:1783141935.128398:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783141935.128422:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510569216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783141935.128710:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510569216:12345-0@lo:502:mount.lustre.0 Request processed in 296us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141935.128725:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783141935.128809:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783141935.128833:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510569216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783141935.130165:0:14757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1783141935.130186:0:14757:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783141935.137381:0:14780:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783141935.137397:0:14780:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff946496e099c0) 00000020:00000080:3.0:1783141935.137417:0:14780:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1783141935.137632:0:14780:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946496822800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783141935.137636:0:14780:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946496822800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783141935.137639:0:14780:0:(obd_mount.c:701:lustre_put_lsi()) put ffff946496822800 3 00010000:00080000:3.0:1783141935.137677:0:14780:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94649e5f6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.127@tcp at head 00010000:00010000:3.0:1783141935.139337:0:14780:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1783141935.139433:0:14780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783141935.139500:0:14780:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783141935.139512:0:14780:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x279ffa91da899830 00000100:00080000:3.0:1783141935.139522:0:14780:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783141935.139528:0:14780:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94649e5f6800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1783141935.139563:0:14780:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946482f4e680 x1869759510569344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783141935.139590:0:14780:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783141935.139626:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783141935.139630:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783141935.139633:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783141935.139636:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783141935.139692:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510569472:0@lo:400:kworker.0 00000100:00100000:3.0:1783141935.139756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.140032:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1869759510569344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783141935.140067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141935.143166:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510569472 00000100:00100000:0.0:1783141935.143179:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510569472 00000100:00100000:0.0:1783141935.143232:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510569344 00000100:00100000:0.0:1783141935.143235:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510569344 00000100:00100000:0.0:1783141935.143252:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141935.143262:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510569472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141935.143366:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510569472:12345-0@lo:400:kworker.0 Request processed in 105us (3610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141935.143384:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141935.143401:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783141935.143405:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1869759510569344:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783141935.143426:0:14124:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1783141935.143501:0:14124:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x279ffa91da899837 00000004:00100000:0.0:1783141935.143518:0:14124:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783141935.143550:0:14124:0:(import.c:65:import_set_state_nolock()) ffff9464b2380800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141935.143591:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1869759510569344:12345-0@lo:38:llog_process_th.0 Request processed in 183us (3522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141935.143597:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783141935.143664:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946482f4e680 x1869759510569344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141935.143675:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783141935.143683:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783141935.143690:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783141935.143695:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783141935.143697:0:3304:0:(import.c:65:import_set_state_nolock()) ffff94649e5f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783141935.143703:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1869759510569344:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783141935.144114:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946482f4ea00 x1869759510569472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141935.144125:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510569472:0@lo:400:kworker.0 00000040:00080000:3.0:1783141935.144622:0:14780:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1783141935.144742:0:14757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783141935.144764:0:14757:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783141935.144785:0:14757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464b25a0600/0x279ffa91da89981b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899822 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141935.144806:0:14757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464b25a0600/0x279ffa91da89981b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899822 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783141935.144872:0:14757:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783141935.144875:0:14757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783141935.144876:0:14757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141935.144878:0:14757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141935.144879:0:14757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141935.144880:0:14757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141935.144882:0:14757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141935.144884:0:14757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141935.144885:0:14757:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783141935.144889:0:14757:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783141935.144891:0:14757:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783141935.144898:0:14757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783141935.144899:0:14757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141935.144900:0:14757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141935.144901:0:14757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141935.144902:0:14757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141935.144902:0:14757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141935.144903:0:14757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141935.144904:0:14757:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783141935.144928:0:14757:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783141935.144945:0:14757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510569600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783141935.145014:0:14757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141935.145089:0:14757:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648981b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141935.145107:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510569600 00000100:00100000:2.0:1783141935.145111:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510569600 00000100:00100000:2.0:1783141935.145309:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783141935.145318:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14757:x1869759510569600:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783141935.145353:0:14117:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783141935.145365:0:14117:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783141935.172189:0:14117:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783141935.172230:0:14117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783141935.172417:0:14139:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783141935.172422:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783141935.172444:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.172508:0:14139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8997a4 expref: 16 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.172535:0:14139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.172574:0:14139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8997a4 expref: 16 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.172586:0:14139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8997a4 expref: 16 pid: 14116 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141935.172600:0:14139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869759510569728:0@lo:104: 00000100:00100000:0.0:1783141935.172662:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141935.172806:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510569728 00000100:00100000:1.0:1783141935.172813:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510569728 00000100:00100000:1.0:1783141935.172860:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141935.172869:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:14139:x1869759510569728:12345-0@lo:104: 00010000:00010000:1.0:1783141935.172881:0:14107:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.172927:0:14107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783141935.172933:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:14139:x1869759510569728:12345-0@lo:104: Request processed in 66us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141935.172940:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1783141935.172960:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141935.172966:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.172973:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0a00 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:1.0:1783141935.172976:0:14111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.172984:0:14111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783141935.172989:0:14111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141935.173002:0:14111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783141935.173028:0:14111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.173034:0:14111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783141935.173052:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.173059:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464b25a0a00/0x279ffa91da8997a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8997ab expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.173074:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141935.173076:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141935.173077:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141935.173100:0:14139:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783141935.173123:0:14139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869759510569728:0@lo:104: 00010000:00010000:0.0:1783141935.173139:0:14139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141935.173212:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783141935.173223:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3306:1869759510569856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141935.173255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141935.174090:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510569856 00000100:00100000:1.0:1783141935.174098:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510569856 00010000:00010000:1.0:1783141935.174120:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8997a4 expref: 17 pid: 14116 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141935.174154:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141935.174161:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:3306:x1869759510569856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783141935.174172:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141935.174177:0:14110:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8997a4 expref: 17 pid: 14116 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174187:0:14110:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8997a4 expref: 17 pid: 14116 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174201:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946496f52800/0x279ffa91da8997ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8997a4 expref: 17 pid: 14116 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174221:0:14110:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174229:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783141935.174242:0:14110:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006451951s 00010000:00010000:1.0:1783141935.174247:0:14110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174252:0:14110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174259:0:14110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174265:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174270:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141935.174274:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174281:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174397:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141935.174408:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141935.174480:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:3306:x1869759510569856:12345-0@lo:103:ldlm_bl.0 Request processed in 319us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141935.174488:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783141935.174559:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3306:1869759510569856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141935.174628:0:14139:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.174637:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141935.174643:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94649d0d6200/0x279ffa91da89983e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141935.183659:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14757:x1869759510569600:12345-0@lo:253:mount.lustre.0 Request processed in 38334us (38641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141935.183675:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783141935.183859:0:14757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14757:1869759510569600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783141935.183874:0:14757:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783141935.183877:0:14757:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783141935.183879:0:14757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783141935.183880:0:14757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783141935.183882:0:14757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783141935.183883:0:14757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783141935.183884:0:14757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783141935.183885:0:14757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783141935.183887:0:14757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783141935.183889:0:14757:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783141935.183904:0:14757:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783141935.188888:0:14757:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141935.189060:0:14757:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783141935.189215:0:14757:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141935.189528:0:14757:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783141935.189673:0:14757:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783141935.189940:0:14757:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783141935.190986:0:14757:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1783141935.246827:0:14757:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783141935.246837:0:14757:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783141935.246868:0:14757:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783141935.246992:0:14757:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783141935.247006:0:14757:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783141935.247034:0:14757:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1783141936.031882:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783141936.351276:0:14155:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783141936.351284:0:14155:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783141936.351397:0:14155:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1783141936.351404:0:14155:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1783141936.475304:0:14119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783141936.475312:0:14119:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9464bb12d800 from 7 10000000:01000000:3.0:1783141936.475317:0:14119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783141936.475363:0:14119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141936.475375:0:14119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141936.475385:0:14119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141936.475426:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510569984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783141936.475522:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141936.475619:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489d2a600 going to sleep for 11 seconds 00000100:00100000:2.0:1783141936.477170:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510569984 00000100:00100000:2.0:1783141936.477181:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510569984 00000100:00100000:2.0:1783141936.477281:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783141936.477291:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+15:14119:x1869759510569984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141936.477308:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141936.477325:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da899845 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141936.477353:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da899845 expref: 16 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141936.477364:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899845 expref: 16 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141936.477374:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a0c00, rc 0) 00000100:00100000:2.0:1783141936.477456:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14119:x1869759510569984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141936.477479:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783141936.477565:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510569984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141936.477583:0:14119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141936.477591:0:14119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141936.477656:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510570112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783141936.477704:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141936.478422:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141936.478576:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510570112 00000100:00100000:3.0:1783141936.478583:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510570112 00000100:00100000:3.0:1783141936.478617:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783141936.478625:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14119:x1869759510570112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783141936.478644:0:14115:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783141936.478661:0:14115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783141936.478664:0:14115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783141936.478759:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14119:x1869759510570112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141936.478766:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783141936.478859:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510570112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783141936.478944:0:14119:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783141936.478953:0:14119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141936.478962:0:14119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141937.053759:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141938.078224:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141939.098992:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141940.130313:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783141940.250938:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783141940.250945:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783141940.250948:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783141940.250951:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783141940.250987:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141940.251007:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510570240:0@lo:400:kworker.0 00000100:00100000:1.0:1783141940.251168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141940.251305:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510570368:0@lo:400:kworker.0 00000100:00100000:1.0:1783141940.251337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141940.251359:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783141940.251364:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510570496:0@lo:400:kworker.0 00000100:00100000:1.0:1783141940.251387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141940.251418:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510570240 00000100:00100000:1.0:1783141940.251425:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510570240 00000100:00100000:1.0:1783141940.251502:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783141940.251511:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:3305:x1869759510570240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141940.251562:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:3305:x1869759510570240:12345-0@lo:400:kworker.0 Request processed in 51us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141940.251583:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783141940.251617:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510570368 00000100:00100000:1.0:1783141940.251621:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510570368 00000100:00100000:1.0:1783141940.251792:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510570496 00000100:00100000:1.0:1783141940.251796:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510570496 00000100:00100000:1.0:1783141940.252426:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141940.252435:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510570368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141940.252505:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510570368:12345-0@lo:400:kworker.0 Request processed in 71us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141940.252513:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141940.252526:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783141940.252532:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510570496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141940.252560:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510570496:12345-0@lo:400:kworker.0 Request processed in 29us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141940.252566:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1783141940.252606:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783141940.252648:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946485001880 x1869759510570496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141940.252941:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510570496:0@lo:400:kworker.0 00010000:00080000:1.0:1783141940.252959:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946485000e00 x1869759510570368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783141940.252969:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510570368:0@lo:400:kworker.0 00000100:00100000:1.0:1783141940.253001:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510570240:0@lo:400:kworker.0 00000001:02000400:3.0:1783141940.939929:0:15126:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783141941.148364:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141942.174144:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141943.194972:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141944.219048:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141945.247528:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783141945.370834:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783141945.370841:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783141945.370845:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783141945.370849:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783141945.370912:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510570624:0@lo:400:kworker.0 00000100:00100000:3.0:1783141945.370980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141945.371009:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510570624 00000100:00100000:1.0:1783141945.371018:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510570624 00000100:00100000:3.0:1783141945.371032:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783141945.371044:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510570752:0@lo:400:kworker.0 00000100:00100000:1.0:1783141945.371069:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783141945.371083:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:3305:x1869759510570624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141945.371089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141945.371133:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510570880:0@lo:400:kworker.0 00000100:00100000:1.0:1783141945.371144:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:3305:x1869759510570624:12345-0@lo:400:kworker.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141945.371152:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783141945.371189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141945.371237:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510570752 00000100:00100000:3.0:1783141945.371241:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510570752 00000100:00100000:3.0:1783141945.371269:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510570880 00000100:00100000:3.0:1783141945.371272:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510570880 00000100:00100000:1.0:1783141945.371297:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783141945.371306:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510570752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141945.371339:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510570752:12345-0@lo:400:kworker.0 Request processed in 34us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141945.371421:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783141945.371432:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510570880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141945.371508:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1869759510570880:12345-0@lo:400:kworker.0 Request processed in 78us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141945.371515:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783141945.371541:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783141945.371575:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946482f4f480 x1869759510570880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141945.371590:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1869759510570880:0@lo:400:kworker.0 00010000:00080000:3.0:1783141945.371631:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946482f4ed80 x1869759510570752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141945.371641:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510570752:0@lo:400:kworker.0 00000100:00100000:3.0:1783141945.371653:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510570624:0@lo:400:kworker.0 00000100:00100000:1.0:1783141945.373034:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783141946.269785:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783141946.428506:0:15426:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783141946.428510:0:15426:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1783141946.428631:0:15426:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9464830bb000 00000020:01000004:1.0:1783141946.428647:0:15426:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783141946.428659:0:15426:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1783141946.428673:0:15426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9464972b19c0) 00000020:00000080:1.0:1783141946.428689:0:15426:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783141946.441423:0:15426:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783141946.441969:0:15426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1783141946.442702:0:15426:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783141946.442943:0:15426:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1783141946.443141:0:15426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1783141946.443556:0:15426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 525: rc = 0 00100000:10000000:1.0:1783141946.443668:0:15426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 525: rc = 0 00100000:10000000:1.0:1783141946.443844:0:15426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 525: rc = 0 00100000:10000000:1.0:1783141946.444240:0:15426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 662: rc = 0 00100000:10000000:1.0:1783141946.444657:0:15426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 662: rc = 0 00100000:10000000:1.0:1783141946.444909:0:15426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 662: rc = 0 00100000:10000000:1.0:1783141946.445159:0:15426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 662: rc = 0 00100000:10000000:1.0:1783141946.445409:0:15426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 662: rc = 0 00100000:10000000:1.0:1783141946.445761:0:15426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 662: rc = 0 00000020:00000080:1.0:1783141946.446281:0:15426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783141946.446292:0:15426:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783141946.446301:0:15426:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x279ffa91da89985a 00000020:01000004:1.0:1783141946.446309:0:15426:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1783141946.446329:0:15426:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.127@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783141946.446333:0:15426:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783141946.446339:0:15426:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783141946.446358:0:15426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1783141946.446363:0:15426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783141946.454613:0:15426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783141946.454651:0:15426:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.127@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1783141946.454656:0:15426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783141946.454658:0:15426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783141946.454660:0:15426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141946.454661:0:15426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141946.454662:0:15426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141946.454663:0:15426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141946.454664:0:15426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141946.454666:0:15426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141946.454667:0:15426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783141946.454670:0:15426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1783141946.454675:0:15426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783141946.454676:0:15426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783141946.454677:0:15426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141946.454678:0:15426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141946.454679:0:15426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141946.454680:0:15426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141946.454681:0:15426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141946.454682:0:15426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141946.454683:0:15426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783141946.454708:0:15426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783141946.454741:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571008:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783141946.454814:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141946.454900:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464ba592a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783141946.454971:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510571008 00000100:00100000:1.0:1783141946.454978:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510571008 00000100:00100000:1.0:1783141946.455048:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783141946.455056:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:15426:x1869759510571008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783141946.455090:0:14116:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783141946.455092:0:14116:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783141946.455095:0:14116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783141946.475778:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:15426:x1869759510571008:12345-0@lo:253:mount.lustre.0 Request processed in 20713us (20956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141946.475792:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783141946.476004:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783141946.476019:0:15426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783141946.476023:0:15426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783141946.476024:0:15426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783141946.476026:0:15426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783141946.476027:0:15426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783141946.476028:0:15426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783141946.476029:0:15426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783141946.476031:0:15426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783141946.476033:0:15426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783141946.476034:0:15426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783141946.476056:0:15426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9464830bb000 from lustre-OST0001 10000000:01000000:0.0:1783141946.476082:0:15426:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783141946.476085:0:15426:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783141946.476092:0:15426:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9464bfed0000 local copy 00010000:00010000:0.0:1783141946.476102:0:15426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141946.476321:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783141946.476354:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141946.476392:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464ba5923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141946.476500:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510571136 00000100:00100000:1.0:1783141946.476506:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510571136 00000100:00100000:1.0:1783141946.476555:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783141946.476563:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:15426:x1869759510571136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141946.476765:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:15426:x1869759510571136:12345-0@lo:501:mount.lustre.0 Request processed in 202us (410us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783141946.476773:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783141946.476934:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571136:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783141946.476950:0:15426:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783141946.477095:0:15426:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783141946.477102:0:15426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.477111:0:15426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe16800/0x279ffa91da8996cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8996d2 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783141946.477130:0:15426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9464830bb000 10000000:01000000:0.0:1783141946.477134:0:15426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783141946.477138:0:15426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783141946.477140:0:15426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783141946.477145:0:15426:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783141946.477148:0:15426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783141946.477169:0:15426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7400/0x279ffa91da899861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.477177:0:15426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff94649d0d7400/0x279ffa91da899861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.477186:0:15426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff94649d0d7400/0x279ffa91da899861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141946.477199:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783141946.477227:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141946.477257:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464ba5923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141946.477420:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510571264 00000100:00100000:1.0:1783141946.477425:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510571264 00000100:00100000:1.0:1783141946.477455:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783141946.477498:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:15426:x1869759510571264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141946.477508:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141946.477519:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946496f53200/0x279ffa91da899868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da899861 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.477539:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f53200/0x279ffa91da899868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da899861 expref: 17 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.477550:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946496f53200/0x279ffa91da899868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899861 expref: 17 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.477558:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53200, rc 0) 00000100:00100000:1.0:1783141946.477586:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571264:12345-0@lo:101:mount.lustre.0 Request processed in 91us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141946.477592:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783141946.477698:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783141946.477710:0:15426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff94649d0d7400/0x279ffa91da899861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899868 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.477736:0:15426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff94649d0d7400/0x279ffa91da899861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da899868 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783141946.479622:0:15426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783141946.481048:0:15426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141946.481281:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783141946.481324:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783141946.481361:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783141946.481410:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783141946.481446:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783141946.481523:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783141946.481595:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783141946.481602:0:15426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783141946.481688:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783141946.481767:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141946.481812:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464bb166e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141946.482034:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510571392 00000100:00100000:1.0:1783141946.482041:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510571392 00000100:00100000:1.0:1783141946.482090:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783141946.482099:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783141946.486549:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571392:12345-0@lo:501:mount.lustre.0 Request processed in 4441us (4771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.486565:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783141946.486837:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783141946.486892:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783141946.486948:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141946.487303:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141946.487842:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510571520 00000100:00100000:1.0:1783141946.487857:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510571520 00000100:00100000:1.0:1783141946.487906:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783141946.487916:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783141946.489895:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571520:12345-0@lo:503:mount.lustre.0 Request processed in 1973us (2939us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.489908:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783141946.490586:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783141946.493602:0:15426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783141946.493697:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783141946.493941:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141946.493993:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141946.494227:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510571648 00000100:00100000:2.0:1783141946.494235:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510571648 00000100:00100000:2.0:1783141946.494288:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783141946.494297:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783141946.497117:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571648:12345-0@lo:502:mount.lustre.0 Request processed in 2813us (3168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.497132:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783141946.499011:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783141946.499678:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1783141946.499754:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1783141946.499789:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1783141946.499839:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1783141946.501039:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1783141946.501236:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1783141946.501302:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1783141946.501340:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1783141946.501403:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1783141946.501453:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783141946.501584:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141946.501631:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464ba5923c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783141946.501765:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510571776 00000100:00100000:3.0:1783141946.501772:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510571776 00000100:00100000:3.0:1783141946.501827:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783141946.501835:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783141946.502014:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571776:12345-0@lo:502:mount.lustre.0 Request processed in 179us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141946.502022:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783141946.503257:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783141946.503815:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1783141946.503830:0:15426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1783141946.504928:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783141946.504938:0:15428:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1783141946.504944:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783141946.504946:0:15428:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783141946.504953:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783141946.504979:0:15428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9464bb840000) 00000020:00000080:2.0:1783141946.505000:0:15428:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783141946.505006:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783141946.505067:0:15428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464830bb000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783141946.505074:0:15428:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783141946.505134:0:15428:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x279ffa91da899876 00010000:00010000:2.0:1783141946.512943:0:15428:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1783141946.513891:0:15428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1783141946.516773:0:15428:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1783141946.518646:0:15428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783141946.518658:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141946.518665:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141946.518667:0:15428:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783141946.518671:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141946.518675:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141946.518676:0:15428:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783141946.518679:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783141946.518681:0:15428:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783141946.518683:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141946.518686:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141946.518687:0:15428:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783141946.518689:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783141946.518691:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141946.518692:0:15428:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783141946.518696:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783141946.518758:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783141946.518761:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783141946.518763:0:15428:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783141946.518776:0:15428:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1783141946.518917:0:15426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1783141946.518942:0:15426:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783141946.518965:0:15426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff94649d0d7400/0x279ffa91da899861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899868 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.518977:0:15426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff94649d0d7400/0x279ffa91da899861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899868 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141946.518987:0:15426:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9464830bb000 from 1 10000000:01000000:1.0:1783141946.519001:0:15426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783141946.519036:0:15426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.519045:0:15426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.519054:0:15426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141946.519078:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783141946.519140:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141946.519184:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497098540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141946.519241:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510571904 00000100:00100000:2.0:1783141946.519248:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510571904 00000100:00100000:2.0:1783141946.519294:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783141946.519303:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:15426:x1869759510571904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783141946.519318:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141946.519331:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89987d expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.519353:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89987d expref: 18 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.519364:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89987d expref: 18 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.519373:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1200, rc 0) 00000100:00100000:2.0:1783141946.519407:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510571904:12345-0@lo:101:mount.lustre.0 Request processed in 106us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.519414:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783141946.519648:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510571904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141946.519664:0:15426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.519681:0:15426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783141946.520161:0:15426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783141946.520692:0:15426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141946.520924:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783141946.520967:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783141946.521023:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783141946.521030:0:15426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783141946.521084:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141946.521129:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141946.521173:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497098540 going to sleep for 11 seconds 00000100:00100000:1.0:1783141946.521199:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510572032 00000100:00100000:1.0:1783141946.521205:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510572032 00000100:00100000:1.0:1783141946.521237:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783141946.521244:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510572032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141946.521409:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510572032:12345-0@lo:501:mount.lustre.0 Request processed in 164us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141946.521416:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783141946.521482:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141946.523621:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572160:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783141946.523699:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141946.525699:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497098540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141946.527341:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510572160 00000100:00100000:2.0:1783141946.527352:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510572160 00000100:00100000:2.0:1783141946.527398:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783141946.527407:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510572160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783141946.528839:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510572160:12345-0@lo:503:mount.lustre.0 Request processed in 1428us (5134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.528851:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783141946.528975:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572160:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783141946.534677:0:15426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783141946.534794:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783141946.534871:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141946.534924:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946497098540 going to sleep for 11 seconds 00000100:00100000:0.0:1783141946.535597:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510572288 00000100:00100000:0.0:1783141946.535606:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510572288 00000100:00100000:0.0:1783141946.535648:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783141946.535658:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfe32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510572288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783141946.535923:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfe32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510572288:12345-0@lo:502:mount.lustre.0 Request processed in 265us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141946.535931:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783141946.536625:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783141946.536883:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783141946.536936:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783141946.536985:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783141946.537635:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783141946.537670:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783141946.537729:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783141946.537762:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783141946.537792:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1783141946.537830:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783141946.537893:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141946.537927:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a780 going to sleep for 11 seconds 00000100:00100000:1.0:1783141946.538703:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510572416 00000100:00100000:1.0:1783141946.538711:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510572416 00000100:00100000:1.0:1783141946.538770:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783141946.538778:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510572416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783141946.538980:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510572416:12345-0@lo:502:mount.lustre.0 Request processed in 202us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141946.538989:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783141946.539647:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783141946.539791:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783141946.539803:0:15426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783141946.542330:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141946.542352:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141946.542354:0:15432:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783141946.542361:0:15432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464830bb000 00000020:00000080:0.0:1783141946.542363:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783141946.542370:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141946.542373:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141946.542374:0:15432:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783141946.542376:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141946.542378:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141946.542380:0:15432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783141946.542383:0:15432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9464830bb000 00000020:00000080:0.0:1783141946.542385:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783141946.542616:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141946.542621:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141946.542623:0:15432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783141946.542625:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783141946.542628:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141946.542629:0:15432:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783141946.542633:0:15432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9464830bb000 00000020:00000080:0.0:1783141946.542635:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783141946.543166:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783141946.543172:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783141946.543173:0:15432:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783141946.543177:0:15432:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1783141946.546756:0:15426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783141946.546803:0:15426:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783141946.546826:0:15426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.546839:0:15426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783141946.546889:0:15426:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783141946.546892:0:15426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9464830bb000 10000000:01000000:1.0:1783141946.546895:0:15426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9464830bb000 10000000:01000000:1.0:1783141946.546899:0:15426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783141946.546905:0:15426:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9464830bb000 from 1 10000000:01000000:1.0:1783141946.546907:0:15426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783141946.546940:0:15426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53a00/0x279ffa91da89988b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.546949:0:15426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff946496f53a00/0x279ffa91da89988b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.546970:0:15426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff946496f53a00/0x279ffa91da89988b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141946.546994:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783141946.547057:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141946.547115:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510572544 00000100:00100000:1.0:1783141946.547121:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510572544 00000100:00100000:1.0:1783141946.547161:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783141946.547170:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510572544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141946.547183:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141946.547194:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946496f53c00/0x279ffa91da899892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da89988b expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.547216:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946496f53c00/0x279ffa91da899892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da89988b expref: 19 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.547225:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946496f53c00/0x279ffa91da899892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89988b expref: 19 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.547233:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f53c00, rc 0) 00000100:00100000:1.0:1783141946.547259:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510572544:12345-0@lo:101:mount.lustre.0 Request processed in 90us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141946.547265:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783141946.547309:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141946.547329:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783141946.547347:0:15426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff946496f53a00/0x279ffa91da89988b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899892 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.547362:0:15426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff946496f53a00/0x279ffa91da89988b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da899892 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783141946.549536:0:15426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1783141946.549872:0:15426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783141946.550163:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783141946.550218:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783141946.550251:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783141946.550295:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783141946.550327:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783141946.550371:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783141946.550410:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783141946.550441:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783141946.550509:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783141946.550544:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783141946.550577:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783141946.550623:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783141946.550658:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783141946.550688:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783141946.550746:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783141946.550784:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783141946.550817:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783141946.550879:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783141946.550912:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783141946.550942:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783141946.550985:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783141946.551017:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783141946.551050:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783141946.551096:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783141946.551132:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1783141946.551165:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1783141946.551223:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1783141946.551257:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1783141946.551287:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1783141946.551329:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1783141946.551362:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1783141946.551395:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1783141946.551429:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1783141946.551512:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1783141946.551548:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1783141946.551592:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1783141946.551627:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1783141946.551704:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1783141946.551711:0:15426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1783141946.556686:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141946.556763:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141946.556805:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141946.556831:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510572672 00000100:00100000:2.0:1783141946.556839:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510572672 00000100:00100000:2.0:1783141946.556881:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783141946.556889:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510572672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783141946.557770:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510572672:12345-0@lo:501:mount.lustre.0 Request processed in 878us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.557779:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783141946.558206:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783141946.558248:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783141946.558292:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141946.558329:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141946.558383:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510572800 00000100:00100000:2.0:1783141946.558389:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510572800 00000100:00100000:2.0:1783141946.558422:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783141946.558430:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510572800:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783141946.559258:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510572800:12345-0@lo:503:mount.lustre.0 Request processed in 827us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.559267:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783141946.559630:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783141946.560769:0:15426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783141946.560849:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783141946.560909:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141946.562315:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510572928 00000100:00100000:2.0:1783141946.562325:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510572928 00000100:00100000:1.0:1783141946.562329:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141946.562364:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783141946.562373:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510572928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783141946.562903:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510572928:12345-0@lo:502:mount.lustre.0 Request processed in 530us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.562911:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783141946.563207:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510572928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783141946.564139:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783141946.564213:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783141946.564246:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783141946.564289:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783141946.564322:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783141946.565219:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783141946.565273:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783141946.565306:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783141946.565384:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783141946.565422:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783141946.565455:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783141946.566212:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783141946.566260:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783141946.566294:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783141946.566340:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783141946.566375:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783141946.566406:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783141946.566450:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783141946.567891:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783141946.567970:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783141946.568048:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783141946.568216:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783141946.568256:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783141946.568307:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783141946.568360:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1783141946.568397:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1783141946.568445:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1783141946.568631:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1783141946.568670:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1783141946.568730:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1783141946.568769:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1783141946.568802:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1783141946.568836:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1783141946.568896:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1783141946.568939:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1783141946.568988:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1783141946.569022:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1783141946.569049:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1783141946.569322:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1783141946.569358:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1783141946.569403:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510573056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783141946.569495:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141946.569957:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f240 going to sleep for 11 seconds 00000100:00100000:3.0:1783141946.570184:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510573056 00000100:00100000:3.0:1783141946.570192:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510573056 00000100:00100000:3.0:1783141946.570240:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783141946.570250:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510573056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783141946.570477:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510573056:12345-0@lo:502:mount.lustre.0 Request processed in 207us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141946.570485:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783141946.570631:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510573056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783141946.570727:0:15426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1783141946.570739:0:15426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783141946.573239:0:15437:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783141946.573268:0:15437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9463831d0000) 00000020:00000080:3.0:1783141946.573287:0:15437:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1783141946.573428:0:15437:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9464830bb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783141946.573432:0:15437:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9464830bb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783141946.573441:0:15437:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9464830bb000 3 00010000:00080000:3.0:1783141946.573604:0:15437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946482b49800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.127@tcp at head 00010000:00010000:3.0:1783141946.579375:0:15437:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1783141946.580258:0:15437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783141946.580302:0:15437:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783141946.580314:0:15437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x279ffa91da8998a0 00000100:00080000:3.0:1783141946.580325:0:15437:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783141946.580331:0:15437:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946482b49800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:3.0:1783141946.580365:0:15437:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946482f4ed80 x1869759510573184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783141946.580386:0:15437:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783141946.581147:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1869759510573184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783141946.581220:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141946.581273:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510573184 00000100:00100000:3.0:1783141946.581281:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510573184 00000100:00080000:2.0:1783141946.581289:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783141946.581293:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783141946.581295:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783141946.581305:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783141946.581315:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141946.581322:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1869759510573184:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783141946.581346:0:14124:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000100:00100000:2.0:1783141946.581375:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510573312:0@lo:400:kworker.0 00000020:00000080:3.0:1783141946.581380:0:14124:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x279ffa91da8998a7 00000004:00100000:3.0:1783141946.581395:0:14124:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783141946.581405:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783141946.581431:0:14124:0:(import.c:65:import_set_state_nolock()) ffff94649d28a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141946.581442:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510573440:0@lo:400:kworker.0 00000100:00100000:2.0:1783141946.581488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783141946.581658:0:15437:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1783141946.582128:0:15426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783141946.582157:0:15426:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783141946.582171:0:15426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff946496f53a00/0x279ffa91da89988b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899892 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141946.582181:0:15426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff946496f53a00/0x279ffa91da89988b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899892 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783141946.582219:0:15426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783141946.582221:0:15426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783141946.582223:0:15426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141946.582224:0:15426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783141946.582225:0:15426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141946.582227:0:15426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141946.582228:0:15426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783141946.582230:0:15426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141946.582231:0:15426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783141946.582234:0:15426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1783141946.582236:0:15426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783141946.582242:0:15426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783141946.582242:0:15426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141946.582243:0:15426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783141946.582244:0:15426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141946.582245:0:15426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141946.582246:0:15426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783141946.582247:0:15426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141946.582247:0:15426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783141946.582263:0:15426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783141946.582276:0:15426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510573568:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783141946.585839:0:14125:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783141946.585856:0:14125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1783141946.585913:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946482f4ed80 x1869759510573184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783141956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141946.585925:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783141946.585935:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783141946.585944:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783141946.585949:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783141946.585953:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946482b49800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783141946.585961:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1869759510573184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783141946.586530:0:14123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783141946.586543:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510573312 00000100:00100000:2.0:1783141946.586549:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510573312 00000100:00100000:2.0:1783141946.586700:0:14123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783141946.586705:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510573440 00000100:00100000:2.0:1783141946.586708:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510573440 00000100:00100000:2.0:1783141946.586730:0:14123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783141946.586741:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783141946.586750:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510573312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141946.586823:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510573312:12345-0@lo:400:kworker.0 Request processed in 74us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.586844:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783141946.586859:0:14123:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783141946.586865:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783141946.586871:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510573440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141946.586906:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510573440:12345-0@lo:400:kworker.0 Request processed in 35us (5418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.586911:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783141946.586943:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946496b25f80 x1869759510573312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141946.586954:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510573312:0@lo:400:kworker.0 00000100:00100000:3.0:1783141946.586966:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1869759510573184:12345-0@lo:38:llog_process_th.0 Request processed in 5643us (5746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141946.586975:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783141946.586979:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946496b24a80 x1869759510573440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141946.586988:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510573440:0@lo:400:kworker.0 00000100:00100000:1.0:1783141946.587148:0:15426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141946.587220:0:15426:0:(client.c:2701:ptlrpc_set_wait()) set ffff946496f1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141946.587253:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510573568 00000100:00100000:2.0:1783141946.587257:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510573568 00000100:00100000:2.0:1783141946.587312:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783141946.587319:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:15426:x1869759510573568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783141946.587340:0:14116:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783141946.587353:0:14116:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000040:00080000:3.0:1783141946.587694:0:14155:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783141946.587699:0:14155:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141946.589953:0:14155:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1783141946.591260:0:14155:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141946.591296:0:14155:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 20000000:01000000:1.0:1783141946.616420:0:14116:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783141946.616500:0:14116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783141946.619597:0:14139:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783141946.619609:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783141946.619649:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.619667:0:14139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899845 expref: 19 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.619675:0:14139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.619734:0:14139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da899845 expref: 19 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.619749:0:14139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da899845 expref: 19 pid: 14116 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141946.619762:0:14139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869759510573696:0@lo:104: 00000100:00100000:0.0:1783141946.619819:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141946.619903:0:14139:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141946.619991:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510573696 00000100:00100000:2.0:1783141946.619998:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510573696 00000100:00100000:2.0:1783141946.620407:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141946.620418:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baaca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:14139:x1869759510573696:12345-0@lo:104: 00010000:00010000:2.0:1783141946.620430:0:14106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.620524:0:14106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783141946.620531:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baaca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:14139:x1869759510573696:12345-0@lo:104: Request processed in 115us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.620538:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141946.624971:0:14139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869759510573696:0@lo:104: 00010000:00010000:0.0:1783141946.625000:0:14139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625088:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141946.625096:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625104:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17200 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:2.0:1783141946.625108:0:14111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625118:0:14111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783141946.625126:0:14111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783141946.625132:0:14111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783141946.625169:0:14111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625175:0:14111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783141946.625205:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625213:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff9464bfe17200/0x279ffa91da899845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da89984c expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625245:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141946.625247:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141946.625249:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141946.625256:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141946.625273:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510573824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783141946.625330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141946.625384:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510573824 00000100:00100000:2.0:1783141946.625390:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510573824 00010000:00010000:2.0:1783141946.625413:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da899845 expref: 20 pid: 14116 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141946.625438:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141946.625446:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+20:3305:x1869759510573824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141946.625481:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141946.625487:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da899845 expref: 20 pid: 14116 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625499:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da899845 expref: 20 pid: 14116 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625512:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0c00/0x279ffa91da89984c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da899845 expref: 20 pid: 14116 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625525:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625534:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783141946.625558:0:14108:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006451951s 00010000:00010000:2.0:1783141946.625563:0:14108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625570:0:14108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625576:0:14108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625581:0:14108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625586:0:14108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7a00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141946.625590:0:14108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625596:0:14108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625608:0:14108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141946.625617:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141946.625660:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3305:x1869759510573824:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.625667:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141946.625699:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510573824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783141946.625871:0:14139:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.625880:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141946.625886:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94649d0d7a00/0x279ffa91da8998ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141946.650450:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:15426:x1869759510573568:12345-0@lo:253:mount.lustre.0 Request processed in 63123us (63294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141946.650498:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783141946.650650:0:15426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:15426:1869759510573568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783141946.650671:0:15426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783141946.650675:0:15426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783141946.650676:0:15426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783141946.650677:0:15426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783141946.650678:0:15426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783141946.650680:0:15426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783141946.650681:0:15426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783141946.650682:0:15426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783141946.650691:0:15426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783141946.650692:0:15426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783141946.650706:0:15426:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783141946.655058:0:15426:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783141946.655382:0:15426:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783141946.655674:0:15426:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783141946.655837:0:15426:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783141946.655986:0:15426:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783141946.656436:0:15426:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783141946.657340:0:15426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783141946.713633:0:15426:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783141946.713642:0:15426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783141946.713680:0:15426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783141946.713748:0:15426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783141946.713762:0:15426:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783141946.713788:0:15426:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1783141947.292803:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141948.316835:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783141948.570677:0:14119:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783141948.570685:0:14119:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9464bb12d800 from 8 10000000:01000000:3.0:1783141948.570690:0:14119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783141948.570744:0:14119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17e00/0x279ffa91da8998b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141948.570757:0:14119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464bfe17e00/0x279ffa91da8998b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141948.570768:0:14119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464bfe17e00/0x279ffa91da8998b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141948.570792:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510573952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783141948.570855:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141948.570955:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464868990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141948.573437:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510573952 00000100:00100000:2.0:1783141948.573450:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510573952 00000100:00100000:2.0:1783141948.573555:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783141948.573565:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:14119:x1869759510573952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141948.573583:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141948.573600:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464b25a1c00/0x279ffa91da8998bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da8998b5 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141948.573627:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464b25a1c00/0x279ffa91da8998bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da8998b5 expref: 19 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141948.573637:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464b25a1c00/0x279ffa91da8998bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8998b5 expref: 19 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141948.573646:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464b25a1c00, rc 0) 00000100:00100000:2.0:1783141948.573727:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:14119:x1869759510573952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (2872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141948.573735:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783141948.573816:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510573952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141948.573834:0:14119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464bfe17e00/0x279ffa91da8998b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8998bc expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141948.573844:0:14119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464bfe17e00/0x279ffa91da8998b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da8998bc expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141948.573910:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510574080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783141948.573944:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141948.574283:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783141948.574399:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510574080 00000100:00100000:1.0:1783141948.574404:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510574080 00000100:00100000:1.0:1783141948.574430:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783141948.574436:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:14119:x1869759510574080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783141948.574452:0:14115:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783141948.574486:0:14115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783141948.574490:0:14115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1783141948.574559:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:14119:x1869759510574080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141948.574566:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783141948.574605:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510574080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783141948.574651:0:14119:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783141948.574658:0:14119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17e00/0x279ffa91da8998b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8998bc expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141948.574667:0:14119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe17e00/0x279ffa91da8998b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da8998bc expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.338862:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141949.660928:0:3304:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141934/real 1783141934] req@ffff946496b27480 x1869759510566784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783141949 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141949.660961:0:3304:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946496b27480 x1869759510566784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783141949 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141949.660972:0:3304:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783141934/real 1783141934] req@ffff946496b24000 x1869759510566912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783141949 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141949.660983:0:3304:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946496b24000 x1869759510566912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783141949 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783141949.661004:0:3304:0:(import.c:65:import_set_state_nolock()) ffff94648b814800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783141949.661032:0:3304:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783141949.661036:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510566784:0@lo:8:kworker.0 00000100:00080000:0.0:1783141949.661042:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946482f0e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783141949.661048:0:3304:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783141949.661050:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510566912:0@lo:8:kworker.0 00000100:00080000:2.0:1783141949.661819:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783141949.661824:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783141949.661828:0:38:0:(import.c:65:import_set_state_nolock()) ffff94648b814800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141949.661833:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:2.0:1783141949.661838:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783141949.661844:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94648b814800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141949.661880:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496b27800 x1869759510574336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783141949.661893:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783141949.661896:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783141949.661898:0:38:0:(import.c:65:import_set_state_nolock()) ffff946482f0e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783141949.661901:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:2.0:1783141949.661904:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783141949.661908:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946482f0e800 using connection 192.168.203.127@tcp/0@lo 00000100:00100000:2.0:1783141949.661919:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946496b25c00 x1869759510574464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783141949.661979:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3307:1869759510574208:0@lo:400:kworker.0 00000100:00100000:2.0:1783141949.661984:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510574592:0@lo:400:kworker.0 00000100:00100000:2.0:1783141949.662049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141949.662051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141949.662132:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510574720:0@lo:400:kworker.0 00000100:00100000:2.0:1783141949.662157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141949.662181:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141949.662187:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510574848:0@lo:400:kworker.0 00000100:00100000:2.0:1783141949.662211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141949.662260:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510574592 00000100:00100000:2.0:1783141949.662267:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510574592 00000100:00100000:2.0:1783141949.662310:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510574720 00000100:00100000:2.0:1783141949.662313:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510574720 00000100:00100000:2.0:1783141949.662355:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510574848 00000100:00100000:2.0:1783141949.662359:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510574848 00000100:00100000:2.0:1783141949.662390:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141949.662399:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510574592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141949.662450:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1869759510574592:12345-0@lo:400:kworker.0 Request processed in 51us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141949.662487:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141949.662505:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141949.662513:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510574720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141949.663018:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510574720:12345-0@lo:400:kworker.0 Request processed in 505us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141949.663025:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141949.663041:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783141949.663049:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510574848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141949.663078:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1869759510574848:12345-0@lo:400:kworker.0 Request processed in 32us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141949.663084:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1783141949.663110:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783141949.663138:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b25500 x1869759510574848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141949.663150:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1869759510574848:0@lo:400:kworker.0 00010000:00080000:2.0:1783141949.663161:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b26d80 x1869759510574720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141949.663183:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510574720:0@lo:400:kworker.0 00010000:00080000:2.0:1783141949.663218:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b25880 x1869759510574592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783141965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141949.663228:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1869759510574592:0@lo:400:kworker.0 00000100:00100000:2.0:1783141949.663706:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510574336:0@lo:8:kworker.0 00000100:00100000:2.0:1783141949.663741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141949.663789:0:3304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510574464:0@lo:8:kworker.0 00000100:00100000:2.0:1783141949.663816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141949.663853:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510574336 00000100:00100000:2.0:1783141949.663857:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510574336 00000100:00100000:2.0:1783141949.663875:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510574464 00000100:00100000:2.0:1783141949.663877:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510574464 00000100:00100000:2.0:1783141949.663887:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141949.663892:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1869759510574336:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783141949.663915:0:14760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:2.0:1783141949.663944:0:14760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da8998c3 00002000:00100000:2.0:1783141949.663958:0:14760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9464bb849800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783141949.663962:0:14760:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783141949.663965:0:14760:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783141949.664273:0:14760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783141949.664297:0:14760:0:(import.c:65:import_set_state_nolock()) ffff9464bb84d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141949.664336:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1869759510574336:12345-0@lo:8:kworker.0 Request processed in 442us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141949.664343:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783141949.664357:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141949.664362:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1869759510574464:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783141949.664375:0:14760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:2.0:1783141949.664391:0:14760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x279ffa91da8998ca 00002000:00100000:2.0:1783141949.664397:0:14760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9464bb84c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113656 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783141949.664400:0:14760:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1783141949.664402:0:14760:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783141949.664626:0:14760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783141949.664656:0:14760:0:(import.c:65:import_set_state_nolock()) ffff9464bb848800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141949.664686:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1869759510574464:12345-0@lo:8:kworker.0 Request processed in 323us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141949.664701:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783141949.664736:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b27800 x1869759510574336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783141969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141949.664746:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783141949.664752:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783141949.664759:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783141949.664764:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783141949.664766:0:3304:0:(import.c:65:import_set_state_nolock()) ffff94648b814800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783141949.664780:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783141949.664785:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510574336:0@lo:8:kworker.0 00010000:00080000:2.0:1783141949.664797:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b25c00 x1869759510574464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783141969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783141949.664804:0:3304:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783141949.664808:0:3304:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783141949.664812:0:3304:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783141949.664815:0:3304:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783141949.664817:0:3304:0:(import.c:65:import_set_state_nolock()) ffff946482f0e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783141949.664835:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783141949.664838:0:3304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1869759510574464:0@lo:8:kworker.0 00000004:00080000:2.0:1783141949.664883:0:14148:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1783141949.664899:0:14148:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14148:1869759510575104:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783141949.664924:0:14148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141949.664941:0:14148:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648beb10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783141949.664959:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783141949.664967:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510574976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783141949.664991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141949.665012:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510575104 00000100:00100000:2.0:1783141949.665016:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510575104 00000100:00100000:2.0:1783141949.665046:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141949.665052:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14148:x1869759510575104:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783141949.665520:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510574976 00000100:00100000:3.0:1783141949.665527:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510574976 00000100:00100000:3.0:1783141949.665560:0:14762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141949.665569:0:14762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1869759510574976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783141949.665593:0:14762:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141949.665654:0:14762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1869759510574976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141949.665662:0:14762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1783141949.666529:0:14147:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00002000:00080000:2.0:1783141949.668602:0:14760:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1783141949.668611:0:14760:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1783141949.668616:0:14760:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:3.0:1783141949.668869:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783141949.668922:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946496b25c00 x1869759510574976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783141949.668945:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510574976:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783141949.669414:0:14146:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1783141949.669446:0:14146:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baacbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14146:1869759510575360:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783141949.669539:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141949.669565:0:14146:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e240 going to sleep for 11 seconds 00000004:00080000:0.0:1783141949.669579:0:14145:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783141949.669920:0:14145:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 456874459323ns, next at 0ns, rc = 0 00000100:00100000:0.0:1783141949.669950:0:14759:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783141949.669956:0:14759:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783141949.670058:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141949.670069:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510575232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141949.670099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141949.670131:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510575232 00000100:00100000:0.0:1783141949.670138:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510575232 00000100:00100000:0.0:1783141949.670184:0:14762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141949.670195:0:14762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510575232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141949.670225:0:14762:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:1.0:1783141949.670228:0:14147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 456874766140ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783141949.670318:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510574208 00000100:00100000:1.0:1783141949.670323:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510574208 00000100:00100000:1.0:1783141949.670577:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783141949.670587:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3307:x1869759510574208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141949.670644:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3307:x1869759510574208:12345-0@lo:400:kworker.0 Request processed in 59us (8596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141949.670805:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783141949.671358:0:14762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510575232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1165us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141949.671367:0:14762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783141949.671398:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510575360 00000100:00100000:0.0:1783141949.671404:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510575360 00000100:00080000:0.0:1783141949.671501:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783141949.671535:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9464baac9500 x1869759510575232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783141965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783141949.671556:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510575232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141949.671568:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3307:1869759510574208:0@lo:400:kworker.0 00000100:00100000:0.0:1783141949.672982:0:15612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783141949.672996:0:15612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14146:x1869759510575360:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783141949.682613:0:15612:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1783141949.682623:0:15612:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1783141949.682629:0:15612:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1783141949.682815:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.682826:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.682841:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.682845:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.682851:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.682873:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.682884:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.682892:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.682922:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783141949.685002:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.685992:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686077:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.686084:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.686090:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686106:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686117:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686124:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686147:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783141949.686166:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783141949.686173:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686181:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.686193:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686202:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686218:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686225:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d9e76bd/0x279ffa91da8998d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686245:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141949.686248:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686255:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.686258:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686265:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686275:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686281:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa4df001/0x279ffa91da8998d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686299:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.686301:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.686303:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.686900:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.686907:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686917:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.686921:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.686925:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686934:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686942:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686948:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686964:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783141949.686974:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141949.686977:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.686994:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1a00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.686998:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.687005:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688112:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688124:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1ab5ef6/0x279ffa91da8998df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688143:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.688144:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.688146:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141949.688207:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.688763:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.688769:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688782:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.688786:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.688790:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688807:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688823:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688831:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688849:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783141949.688860:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141949.688864:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688871:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0a00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.688875:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688884:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688897:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.688904:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a878942c/0x279ffa91da8998e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.690664:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.690678:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.690682:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.696433:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.696447:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.696478:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.696483:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.696489:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.696504:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.696514:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.696521:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.696547:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783141949.696979:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.696985:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.696994:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.696997:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.697002:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698143:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698155:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698162:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698187:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783141949.698204:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783141949.698209:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698216:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.698222:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698230:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698247:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698254:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c63944fe/0x279ffa91da8998ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698288:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141949.698291:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698298:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a1600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.698301:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698308:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698317:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698323:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fa1f116/0x279ffa91da8998f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698333:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.698335:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.698336:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.698977:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.698984:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.698995:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.699003:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.699008:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.699560:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.699572:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.699579:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.699595:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783141949.699605:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141949.699610:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.699616:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.699620:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.699627:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.699639:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.699657:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b1aa72/0x279ffa91da8998fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.699676:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.699678:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.699680:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.701337:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.701348:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701362:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.701439:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.701445:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701476:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701486:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701494:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701512:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783141949.701524:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141949.701536:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701543:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464b25a0800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.701547:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701557:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701572:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701579:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029725d9c/0x279ffa91da899902 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.701598:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.701599:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.701601:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.703301:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.703313:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.703328:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.703332:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.703341:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141949.703390:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.703398:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.703409:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.703412:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.703428:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.703436:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.703442:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.703449:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.703454:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.703482:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.703485:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.703509:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783141949.708168:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783141949.708181:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.708194:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7aa00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141949.708199:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.708211:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.708236:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.708244:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f6e59c/0x279ffa91da899909 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.708264:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141949.708269:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.708276:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141949.708280:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.708287:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.708313:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.708323:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141949.708325:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141949.708326:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.710038:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783141949.710051:0:15612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899910 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141949.712713:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.712725:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.712742:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.712747:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.712753:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.712767:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.712777:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.712784:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.712797:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783141949.713327:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.713334:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.713343:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.713347:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.713358:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.713368:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.713377:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.713384:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.713408:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783141949.714663:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783141949.714673:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714683:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.714687:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714706:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714725:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714732:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899917 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714773:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783141949.714777:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714784:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141949.714788:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714794:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714805:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714812:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da89991e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.714826:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.714828:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.714830:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.715384:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.715391:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.715403:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.715414:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.716575:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.717132:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.717140:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717154:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.717157:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.717163:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717175:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717184:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717197:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717220:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.717233:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.717238:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717246:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.717250:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717259:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717274:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717281:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da89992c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717299:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.717301:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.717302:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.717723:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.717737:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717745:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.717749:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.717753:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717763:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717772:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717779:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717793:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.717802:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.717807:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717813:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.717817:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717824:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717842:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717849:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da899933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.717862:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.717864:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.717866:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.718260:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.718266:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718275:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.718278:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.718282:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718292:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718300:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718307:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718333:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.718341:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.718345:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718351:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.718354:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718362:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718373:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718380:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da89993a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.718394:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.718395:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.718397:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783141949.719767:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.719785:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.719795:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.719802:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.719825:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783141949.720371:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.720378:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.720389:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.720392:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.720396:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.720405:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.720413:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.720427:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.720441:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783141949.721040:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.721047:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721056:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.721059:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.721063:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721071:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721079:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721085:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721093:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1783141949.721446:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.721452:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721491:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.721494:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.721498:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721507:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721516:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721523:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.721532:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783141949.723477:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783141949.723487:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723499:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7ac00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.723514:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723526:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723548:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723556:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cc76e20/0x279ffa91da899925 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723576:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783141949.723580:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723586:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.723589:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723597:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723606:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723613:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005939bc21/0x279ffa91da899941 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723632:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783141949.723636:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723642:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7ae00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.723644:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723652:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723662:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723669:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a69db2b2/0x279ffa91da899948 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723681:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.723684:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723690:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.723706:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723725:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723735:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723743:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d7ffafd/0x279ffa91da89994f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.723755:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.723757:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.723759:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.723766:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.724246:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.724253:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724266:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.724270:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.724275:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724286:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724294:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724309:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724327:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783141949.724763:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.724769:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724778:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.724781:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.724785:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724793:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724802:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724809:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724826:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783141949.724838:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783141949.724843:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724856:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.724861:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724869:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724883:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724891:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899956 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724907:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.724910:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724917:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174400 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.724920:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724927:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724935:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724948:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9727172/0x279ffa91da89995d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.724960:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.724962:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.724963:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.725357:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.725363:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725372:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.725376:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.725380:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725389:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725397:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725404:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725418:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.725427:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.725436:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725443:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175e00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.725446:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725454:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725487:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725494:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ed8078a/0x279ffa91da899964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725510:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.725512:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.725514:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.725935:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.725942:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725950:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.725953:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.725957:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725978:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725986:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.725992:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726006:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.726014:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.726017:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726024:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175400 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.726027:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726034:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726045:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726051:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da89996b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726070:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.726071:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.726073:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.726483:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.726489:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726498:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.726501:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.726505:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726513:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726521:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726528:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726542:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.726550:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.726555:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726571:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.726574:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726582:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726595:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726603:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.726621:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.726624:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.726626:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.727333:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.727810:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.727819:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.727830:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.727834:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.727839:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.727850:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.727871:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.727878:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.727898:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783141949.728361:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.728367:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728375:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.728378:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.728382:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728391:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728400:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728407:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728433:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783141949.728904:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.728911:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728920:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.728923:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.728928:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728937:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728946:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728953:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.728962:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1783141949.729367:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.729373:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729381:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.729391:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.729395:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729404:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729412:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729419:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729428:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1783141949.729859:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.729865:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729874:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.729876:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.729880:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729889:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729898:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729911:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.729920:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1783141949.730400:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.730406:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.730415:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.730417:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.730421:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.730429:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.730436:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.730442:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.730449:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1783141949.731227:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783141949.731238:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731248:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.731253:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731262:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731284:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731293:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a87f4487/0x279ffa91da899979 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731317:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783141949.731321:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731328:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7ba00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.731332:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731352:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731364:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731371:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014336219/0x279ffa91da899980 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731385:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783141949.731388:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731394:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.731397:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731405:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731414:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731421:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899987 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731445:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783141949.731449:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731455:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7bc00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.731474:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731483:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731493:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731501:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da89998e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731513:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141949.731517:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731523:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.731526:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731544:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731555:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731562:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899995 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731575:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141949.731578:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731584:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.731588:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731595:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731604:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731612:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da89999c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.731633:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.731635:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.731637:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.734538:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.735041:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.735052:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.735068:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.735073:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.735079:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.735104:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.735115:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.735123:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783141949.736525:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.736536:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.736559:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.736563:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.736568:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.736581:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.736591:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.736611:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.736993:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783141949.737539:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.737547:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.737559:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.737562:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.737566:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.737575:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.737583:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.737614:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783141949.738089:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1783141949.738315:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783141949.738323:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.738333:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141949.738337:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.738346:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.738364:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.738372:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da8999a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.738789:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783141949.739702:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141949.739711:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.739721:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7be00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.739725:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.739735:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.739750:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.739757:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da8999aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.739775:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141949.739779:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.739785:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.739796:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.739805:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.739817:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.739826:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.739828:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.739830:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.740488:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.740496:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.740508:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.740512:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.740517:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.740530:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.740550:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.740557:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.740572:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.740706:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.740712:0:15612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da8999b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783141949.741178:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.741185:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.741196:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.741199:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.741202:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.741213:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.741221:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.741227:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.741245:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783141949.742340:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141949.742348:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742358:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.742364:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742374:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742392:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742400:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da8999b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742423:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141949.742427:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742433:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.742436:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742442:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742453:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742475:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a6eca70/0x279ffa91da8999bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.742491:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.742493:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.742494:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.743054:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.743061:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743073:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.743076:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.743080:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743092:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743100:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743106:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743121:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.743130:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.743134:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743140:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.743149:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743157:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743169:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743176:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000445535cf/0x279ffa91da8999c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743190:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.743192:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.743193:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.743638:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.743644:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743652:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.743654:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.743658:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743666:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743673:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743685:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743707:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.743716:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.743719:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743725:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.743728:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743736:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743745:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743752:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017441089/0x279ffa91da8999cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.743764:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.743765:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.743767:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.744145:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.744157:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744164:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.744168:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.744171:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744180:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744187:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744195:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744208:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.744216:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.744220:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744225:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174a00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.744228:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744235:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744253:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744261:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016a8b126/0x279ffa91da8999d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744275:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.744276:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.744278:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.744682:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.744688:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744711:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.744714:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.744719:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744728:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744736:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744743:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744768:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.744776:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.744780:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744786:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.744790:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744798:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744809:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744816:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f85985e4/0x279ffa91da8999db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.744829:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.744830:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.744832:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.745217:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.745222:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745231:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.745239:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.745243:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745252:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745260:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745266:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745279:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.745287:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.745289:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745295:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.745298:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745306:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745316:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745333:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4205a34/0x279ffa91da8999e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.745348:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.745350:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.745352:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783141949.746343:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.746352:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746364:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.746368:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.746373:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746384:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746393:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746401:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746440:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783141949.746882:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.746888:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746897:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.746900:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.746905:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746914:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746922:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746929:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.746937:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783141949.747347:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.747353:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747362:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.747371:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.747375:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747385:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747393:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747400:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747408:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1783141949.747850:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.747856:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747865:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.747868:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.747871:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747880:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747888:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747902:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.747910:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1783141949.748310:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.748316:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748325:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.748327:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.748331:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748339:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748346:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748353:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748361:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1783141949.748883:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783141949.748890:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748905:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1783141949.748908:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141949.748912:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748922:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748930:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748937:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141949.748945:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00080000:2.0:1783141949.749103:0:14760:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1783141949.749198:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14148:x1869759510575104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 84142us (84269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141949.749207:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141949.749264:0:14148:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14148:1869759510575104:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783141949.749281:0:14148:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1783141949.749325:0:14148:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14148:1869759510575488:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783141949.749359:0:14148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141949.749404:0:14148:0:(client.c:2701:ptlrpc_set_wait()) set ffff946487666540 going to sleep for 11 seconds 00000100:00100000:2.0:1783141949.749427:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510575488 00000100:00100000:2.0:1783141949.749434:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510575488 00000100:00100000:2.0:1783141949.749497:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783141949.749505:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14148:x1869759510575488:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783141949.749541:0:14759:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1783141949.750678:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783141949.750686:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750710:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b400 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.750722:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750733:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750752:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750759:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008c28ded/0x279ffa91da8999e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750780:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783141949.750784:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750790:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a400 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.750793:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750800:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750809:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750816:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c63dd4e9/0x279ffa91da8999f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750836:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783141949.750840:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750847:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.750850:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750857:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750867:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750874:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da8999f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750885:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783141949.750889:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750895:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.750898:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750916:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750926:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750933:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049fdc0ae/0x279ffa91da8999fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750947:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783141949.750950:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750956:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.750959:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750966:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750975:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.750981:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d18cac1/0x279ffa91da899a05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.751004:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141949.751007:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.751013:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7bc00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.751016:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.751023:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.751033:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.751040:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899a0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.751052:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.751053:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.751055:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.751969:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.751979:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.751991:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.751994:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.752000:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.752012:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.752021:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.752028:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.752044:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.752053:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.752064:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.752070:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.752074:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.752082:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.752095:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.752102:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000907af53a/0x279ffa91da899a13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.752116:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.752118:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.752119:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.755848:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.755861:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.755877:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.755882:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.755887:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.755913:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.755923:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.755931:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.755952:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.755968:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.755973:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.755980:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.755985:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.755993:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756008:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756015:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d813e608/0x279ffa91da899a1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756040:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.756042:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.756044:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.756539:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.756545:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756554:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.756557:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.756562:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756570:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756578:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756585:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756675:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.756686:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.756690:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756718:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.756721:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756729:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756741:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756747:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd993d58/0x279ffa91da899a21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.756762:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.756764:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.756765:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.757179:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.757185:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757194:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.757197:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.757201:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757210:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757223:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757230:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757243:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.757252:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.757256:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757262:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f53000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.757265:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757273:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757283:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757291:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002846ce6/0x279ffa91da899a28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.757304:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.757312:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.757314:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141949.757796:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141949.757800:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141949.757802:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.757994:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.758000:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.758011:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.758014:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.758019:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.758028:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.758037:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.758043:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.758108:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783141949.758544:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.758552:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.758561:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.758564:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.758569:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.758585:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.758593:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.758679:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.762062:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783141949.762073:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.762087:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141949.762091:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.762103:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.762123:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141949.762131:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b27be8c7/0x279ffa91da899a2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.764675:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.764722:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.764730:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.764744:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.764749:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.764759:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.764780:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.764787:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000180d3d86/0x279ffa91da899a36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.764820:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.764822:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.764823:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.765404:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.765412:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765423:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.765427:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.765433:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765444:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765452:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765483:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765501:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.765510:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.765513:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765531:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.765534:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765543:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765555:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765561:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020f52563/0x279ffa91da899a3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765575:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.765577:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.765578:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.765970:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.765977:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.765986:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.765989:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.765993:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766001:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766015:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766022:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766045:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783141949.766090:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783141949.766095:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.766103:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:0.0:1783141949.766113:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.766132:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.766145:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.766152:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aa053a9/0x279ffa91da899a44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141949.766165:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.766167:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141949.766169:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783141949.766812:0:15612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783141949.766820:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766830:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1783141949.766833:0:15612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141949.766837:0:15612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766847:0:15612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766856:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766863:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766886:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141949.766895:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141949.766899:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766906:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2175400 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141949.766910:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766917:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766930:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766938:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a358fa1/0x279ffa91da899a4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141949.766951:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.766953:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141949.766954:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783141949.767128:0:15612:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1783141949.767178:0:15612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14146:x1869759510575360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 94180us (97634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141949.767178:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14148:x1869759510575488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17669us (17813us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783141949.767187:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783141949.767197:0:15612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783141949.767475:0:14148:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14148:1869759510575488:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783141949.767490:0:14148:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1783141949.767532:0:14146:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baacbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14146:1869759510575360:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783141949.767543:0:14146:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1783141949.767583:0:14146:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464baacbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14146:1869759510575616:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783141949.767614:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141949.767653:0:14146:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648759e240 going to sleep for 11 seconds 00000100:00100000:2.0:1783141949.767662:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510575616 00000100:00100000:2.0:1783141949.767668:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510575616 00000100:00100000:2.0:1783141949.767716:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783141949.767724:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14146:x1869759510575616:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783141949.767760:0:14761:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1783141949.768439:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141949.768443:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141949.768445:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141949.771849:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14146:x1869759510575616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4119us (4228us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783141949.771861:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783141949.772037:0:14146:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464baacbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14146:1869759510575616:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783141949.772053:0:14146:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:2.0:1783141949.785531:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1783141950.362643:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783141950.623604:0:6610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1783141950.623625:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1783141951.392009:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783141952.150478:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1783141952.150532:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:0.0:1783141952.348356:0:15786:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg327-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783141952.412512:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141953.434862:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141954.458692:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141954.479613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141954.479728:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492758272 00000100:00100000:2.0:1783141954.479738:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492758272 00000100:00100000:2.0:1783141954.479833:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:2.0:1783141954.479842:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649d135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2365:x1869759492758272:12345-192.168.203.27@tcp:250:mount.lustre.0 00010000:00080000:2.0:1783141954.479872:0:14116:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 1bce1679-fe1e-4e1b-8f40-0c055bbb8a76@192.168.203.27@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:2.0:1783141954.479903:0:14116:0:(genops.c:1406:class_connect()) connect: client 1bce1679-fe1e-4e1b-8f40-0c055bbb8a76, cookie 0x279ffa91da899a52 00000100:00080000:2.0:1783141954.480039:0:14116:0:(import.c:65:import_set_state_nolock()) ffff9464bfbb3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141954.480114:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649d135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+5:2365:x1869759492758272:12345-192.168.203.27@tcp:250:mount.lustre.0 Request processed in 271us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141954.480123:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 74 00000100:00100000:0.0:1783141954.485916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141954.486017:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492758400 00000100:00100000:1.0:1783141954.486027:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492758400 00000100:00100000:1.0:1783141954.486084:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:1.0:1783141954.486095:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+5:13684:x1869759492758400:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783141954.486113:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141954.486131:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2174a00/0x279ffa91da899a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0174 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141954.486158:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2174a00/0x279ffa91da899a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0174 expref: 6 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141954.486167:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2174a00/0x279ffa91da899a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0174 expref: 6 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141954.486176:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174a00, rc 0) 00000100:00100000:1.0:1783141954.486244:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+6:13684:x1869759492758400:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 150us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141954.486252:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 75 00000100:00100000:3.0:1783141954.501376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141954.501520:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492758528 00000100:00100000:2.0:1783141954.501543:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492758528 00000100:00100000:2.0:1783141954.501683:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:2.0:1783141954.501695:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+6:13684:x1869759492758528:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783141954.502070:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+6:13684:x1869759492758528:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 376us (709us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783141954.502080:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 76 00000100:00100000:0.0:1783141954.506633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141954.506955:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492758656 00000100:00100000:3.0:1783141954.506965:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492758656 00000100:00100000:3.0:1783141954.507027:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:3.0:1783141954.507037:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+6:13684:x1869759492758656:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783141954.507067:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141954.507870:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464bfe16400/0x279ffa91da899a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a017b expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141954.507908:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464bfe16400/0x279ffa91da899a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a017b expref: 7 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141954.507920:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464bfe16400/0x279ffa91da899a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a017b expref: 7 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141954.507934:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16400, rc 0) 00000100:00100000:3.0:1783141954.507995:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+7:13684:x1869759492758656:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 960us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141954.508003:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 77 00000100:00100000:0.0:1783141954.517937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141954.518059:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492758784 00000100:00100000:1.0:1783141954.518068:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492758784 00000100:00100000:1.0:1783141954.518124:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:1.0:1783141954.518133:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+7:13684:x1869759492758784:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783141954.518416:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+8:13684:x1869759492758784:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 282us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141954.518432:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 78 00000100:00100000:0.0:1783141954.521181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141954.521263:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492758912 00000100:00100000:3.0:1783141954.521272:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492758912 00000100:00100000:3.0:1783141954.521328:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:3.0:1783141954.521339:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+8:13684:x1869759492758912:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783141954.521787:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+8:13684:x1869759492758912:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 449us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141954.521796:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 79 00000100:00100000:0.0:1783141954.528243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141954.528483:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492759040 00000100:00100000:2.0:1783141954.528494:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492759040 00000100:00100000:2.0:1783141954.528551:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:2.0:1783141954.528571:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+8:13703:x1869759492759040:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783141954.528946:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+8:13703:x1869759492759040:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 385us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141954.528955:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 80 00000100:00100000:0.0:1783141954.549947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141954.551801:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492759168 00000100:00100000:3.0:1783141954.551812:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492759168 00000100:00100000:3.0:1783141954.551879:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:3.0:1783141954.551889:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+8:13703:x1869759492759168:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783141954.553776:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+8:13703:x1869759492759168:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 1879us (3828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141954.553801:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 81 00000100:00100000:0.0:1783141954.570328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141954.570804:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492759296 00000100:00100000:1.0:1783141954.570815:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492759296 00000100:00100000:1.0:1783141954.570868:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:1.0:1783141954.570877:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+8:13684:x1869759492759296:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783141954.570892:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141954.570908:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175000/0x279ffa91da899a67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a01a5 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141954.570935:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175000/0x279ffa91da899a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01a5 expref: 9 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141954.570945:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175000/0x279ffa91da899a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01a5 expref: 9 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141954.570954:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175000, rc 0) 00000100:00100000:1.0:1783141954.571203:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+9:13684:x1869759492759296:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 325us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141954.571211:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:1.0:1783141954.576380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141954.576500:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492759424 00000100:00100000:3.0:1783141954.576510:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492759424 00000100:00100000:2.0:1783141954.576814:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00100000:2.0:1783141954.576826:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+9:13684:x1869759492759424:12345-192.168.203.27@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783141954.576851:0:14115:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783141954.576873:0:14115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783141954.576877:0:14115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783141954.576880:0:14115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783141954.576882:0:14115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783141954.578861:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+9:13684:x1869759492759424:12345-192.168.203.27@tcp:256:mount.lustre.0 Request processed in 2027us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141954.578876:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00100000:3.0:1783141954.583964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141954.584134:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492759552 00000100:00100000:1.0:1783141954.584144:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492759552 00000100:00100000:1.0:1783141954.584282:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:1.0:1783141954.584295:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfeccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+9:13684:x1869759492759552:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783141954.584312:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141954.584327:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a01ac expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141954.584376:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01ac expref: 10 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141954.584387:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01ac expref: 10 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141954.584396:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174200, rc 0) 00000100:00100000:1.0:1783141954.584540:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfeccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13684:x1869759492759552:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 247us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141954.584548:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 84 00000100:00100000:1.0:1783141954.587148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141954.587269:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492759680 00000100:00100000:2.0:1783141954.587280:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492759680 00000100:00100000:2.0:1783141954.587392:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:2.0:1783141954.587403:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13684:x1869759492759680:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783141954.587770:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13684:x1869759492759680:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 368us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141954.587779:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 85 00000100:00100000:2.0:1783141954.589723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141954.589802:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492759808 00000100:00100000:1.0:1783141954.589811:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492759808 00000100:00100000:1.0:1783141954.589856:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:1.0:1783141954.589866:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13684:x1869759492759808:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783141954.590166:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13684:x1869759492759808:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 299us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141954.590175:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:1.0:1783141954.594150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141954.594495:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492759936 00000100:00100000:2.0:1783141954.594506:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492759936 00000100:00100000:2.0:1783141954.594579:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 87 00000100:00100000:2.0:1783141954.594591:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13707:x1869759492759936:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783141954.594887:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13707:x1869759492759936:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 297us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141954.594896:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 87 00000100:00100000:2.0:1783141954.597938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141954.598024:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492760064 00000100:00100000:1.0:1783141954.598034:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492760064 00000100:00100000:1.0:1783141954.598082:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 88 00000100:00100000:1.0:1783141954.598091:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13707:x1869759492760064:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783141954.598366:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13707:x1869759492760064:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 273us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141954.598383:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 88 00000100:00100000:1.0:1783141954.614882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141954.614969:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492760192 00000100:00100000:2.0:1783141954.614977:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492760192 00000100:00100000:2.0:1783141954.615018:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:2.0:1783141954.615025:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2365:x1869759492760192:12345-192.168.203.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783141954.615053:0:14123:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 336df830-3a74-41f7-9e23-8cb53be5699f@192.168.203.27@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:2.0:1783141954.615101:0:14123:0:(genops.c:1406:class_connect()) connect: client 336df830-3a74-41f7-9e23-8cb53be5699f, cookie 0x279ffa91da899a75 00000004:00100000:2.0:1783141954.615128:0:14123:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1783141954.615133:0:14123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1783141954.670655:0:14123:0:(import.c:65:import_set_state_nolock()) ffff9464b2386800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783141954.670749:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+6:2365:x1869759492760192:12345-192.168.203.27@tcp:38:mount.lustre.0 Request processed in 55723us (55875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141954.670760:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:1.0:1783141954.678103:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141954.678218:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492760448 00000100:00100000:2.0:1783141954.678229:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492760448 00000100:00100000:2.0:1783141954.678306:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:2.0:1783141954.678316:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+6:13684:x1869759492760448:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783141954.678367:0:14125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1783141954.678478:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141954.684318:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+6:13684:x1869759492760448:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 5991us (6213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141954.684332:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:1.0:1783141954.685217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141954.685350:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492760320 00000100:00100000:3.0:1783141954.685360:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492760320 00000100:00100000:3.0:1783141954.685416:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:3.0:1783141954.685427:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+6:0:x1869759492760320:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783141954.685481:0:14124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783141954.700976:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+6:0:x1869759492760320:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 15539us (15749us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141954.700992:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1783141954.707708:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141954.708272:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492760576 00000100:00100000:3.0:1783141954.708282:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492760576 00000100:00100000:3.0:1783141954.708394:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1783141954.708405:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+6:13684:x1869759492760576:12345-192.168.203.27@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783141954.708690:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+6:13684:x1869759492760576:12345-192.168.203.27@tcp:40:mount.lustre.0 Request processed in 285us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141954.708698:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:0.0:1783141954.713209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141954.713258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141954.713341:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492760832 00000100:00100000:1.0:1783141954.713341:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492760704 00000100:00100000:2.0:1783141954.713352:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492760832 00000100:00100000:1.0:1783141954.713352:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492760704 00000100:00100000:1.0:1783141954.713399:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1783141954.713407:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baaca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869759492760704:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783141954.713436:0:14760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 336df830-3a74-41f7-9e23-8cb53be5699f@192.168.203.27@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1783141954.713512:0:14760:0:(genops.c:1406:class_connect()) connect: client 336df830-3a74-41f7-9e23-8cb53be5699f, cookie 0x279ffa91da899a7c 00002000:00100000:1.0:1783141954.713535:0:14760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 336df830-3a74-41f7-9e23-8cb53be5699f/ffff946381943000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783141954.713561:0:14760:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783141954.713887:0:14760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783141954.713916:0:14760:0:(import.c:65:import_set_state_nolock()) ffff946381947000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783141954.713977:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baaca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:336df830-3a74-41f7-9e23-8cb53be5699f+6:2365:x1869759492760704:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 570us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141954.713985:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1783141954.714003:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:0.0:1783141954.714301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141954.714341:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869759492760832:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783141954.714364:0:14760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 336df830-3a74-41f7-9e23-8cb53be5699f@192.168.203.27@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1783141954.714383:0:14760:0:(genops.c:1406:class_connect()) connect: client 336df830-3a74-41f7-9e23-8cb53be5699f, cookie 0x279ffa91da899a83 00002000:00100000:1.0:1783141954.714390:0:14760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 336df830-3a74-41f7-9e23-8cb53be5699f/ffff946381943800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783141954.714416:0:14760:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783141954.714960:0:14760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783141954.714984:0:14760:0:(import.c:65:import_set_state_nolock()) ffff9464bfbb1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141954.715041:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:336df830-3a74-41f7-9e23-8cb53be5699f+6:2365:x1869759492760832:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 1022us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141954.715049:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1783141954.715715:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492760960 00000100:00100000:3.0:1783141954.715723:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492760960 00000100:00100000:3.0:1783141954.715877:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:3.0:1783141954.715888:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+6:13684:x1869759492760960:12345-192.168.203.27@tcp:33:mount.lustre.0 00000004:00080000:0.0:1783141954.717752:0:14126:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1771us 00000004:00200000:1.0:1783141954.732190:0:14126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1783141954.732376:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+6:13684:x1869759492760960:12345-192.168.203.27@tcp:33:mount.lustre.0 Request processed in 16485us (18070us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141954.732391:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:2.0:1783141954.956257:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141954.956357:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492761088 00000100:00100000:0.0:1783141954.956367:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492761088 00000100:00100000:0.0:1783141954.956481:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:0.0:1783141954.956491:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+6:13728:x1869759492761088:12345-192.168.203.27@tcp:101:mkdir.0 00010000:00010000:0.0:1783141954.956512:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141954.956537:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899a8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a01d6 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141954.956614:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899a91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141954.956642:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141954.956666:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141954.956871:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783141954.956876:0:14123:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141954.956973:0:14123:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141954.956998:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899a8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01d6 expref: 8 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141954.957016:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01d6 expref: 7 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141954.957024:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141954.957027:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141954.957030:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6000, rc 0) 00000100:00100000:0.0:1783141954.957093:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+7:13728:x1869759492761088:12345-192.168.203.27@tcp:101:mkdir.0 Request processed in 603us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141954.957101:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:1.0:1783141955.100252:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141955.100276:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510575744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141955.100374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141955.100474:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510575744 00000100:00100000:2.0:1783141955.100482:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510575744 00000100:00100000:2.0:1783141955.100529:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783141955.100538:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510575744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783141955.100561:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141955.100617:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510575744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141955.100624:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783141955.101486:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141955.101582:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783141955.101610:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510575744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141955.101735:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510576256:0@lo:400:kworker.0 00000100:00100000:0.0:1783141955.101745:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510576000:0@lo:400:kworker.0 00000100:00100000:1.0:1783141955.101774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141955.101774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141955.101804:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783141955.101810:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510576128:0@lo:400:kworker.0 00000100:00100000:0.0:1783141955.101831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141955.101834:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510576256 00000100:00100000:2.0:1783141955.101839:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510576256 00000100:00100000:0.0:1783141955.101864:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510576000 00000100:00100000:0.0:1783141955.101868:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510576000 00000100:00100000:2.0:1783141955.101880:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510576128 00000100:00100000:0.0:1783141955.101895:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141955.101903:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510576000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141955.101958:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510576000:12345-0@lo:400:kworker.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141955.101965:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141955.101985:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783141955.101990:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783141955.101992:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510576256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141955.101998:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510576512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141955.102032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783141955.102056:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783141955.102059:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141955.102066:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510576512 00000100:00100000:3.0:1783141955.102070:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510576512 00000100:00100000:3.0:1783141955.102094:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141955.102101:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510576512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783141955.102124:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141955.102158:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510576512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141955.102165:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783141955.102188:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1783141955.102201:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510576512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141955.102216:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510576256:12345-0@lo:400:kworker.0 Request processed in 224us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141955.102223:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783141955.102227:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3306:1869759510575872:0@lo:400:kworker.0 00000100:00100000:3.0:1783141955.102259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141955.102263:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510576000:0@lo:400:kworker.0 00000100:00100000:0.0:1783141955.102282:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510575872 00000100:00100000:3.0:1783141955.102284:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510576384:0@lo:400:kworker.0 00000100:00100000:0.0:1783141955.102285:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510575872 00000100:00100000:0.0:1783141955.102311:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783141955.102317:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3306:x1869759510575872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141955.102348:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3306:x1869759510575872:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141955.102354:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783141955.102649:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510576128 00000100:00100000:2.0:1783141955.102698:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141955.102705:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510576128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141955.102748:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1869759510576128:12345-0@lo:400:kworker.0 Request processed in 44us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141955.102764:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783141955.102793:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1869759510576128:0@lo:400:kworker.0 00000100:00100000:1.0:1783141955.102871:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510576256:0@lo:400:kworker.0 00000100:00100000:3.0:1783141955.103084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141955.103230:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510576384 00000100:00100000:0.0:1783141955.103235:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510576384 00000100:00100000:0.0:1783141955.103270:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783141955.103277:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510576384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783141955.103324:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3306:1869759510575872:0@lo:400:kworker.0 00000100:00080000:3.0:1783141955.103353:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141955.107079:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1869759510576384:12345-0@lo:400:kworker.0 Request processed in 3793us (4759us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141955.107122:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783141955.109014:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1869759510576384:0@lo:400:kworker.0 00010000:00010000:1.0:1783141955.485210:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783141955.659996:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 336df830-3a74-41f7-9e23-8cb53be5699f 00010000:00010000:1.0:1783141956.510790:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783141956.827233:0:14155:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783141956.862691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141956.862965:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492761216 00000100:00100000:3.0:1783141956.862981:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492761216 00000100:00100000:3.0:1783141956.863091:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:3.0:1783141956.863103:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+7:13780:x1869759492761216:12345-192.168.203.27@tcp:41:lfs.0 00000004:00000024:3.0:1783141956.863178:0:14125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783141956.863293:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+7:13780:x1869759492761216:12345-192.168.203.27@tcp:41:lfs.0 Request processed in 192us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141956.863301:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00080000:0.0:1783141956.863380:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141956.868960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141956.869106:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492761344 00000100:00100000:3.0:1783141956.869124:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492761344 00000100:00100000:3.0:1783141956.869269:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:3.0:1783141956.869282:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:336df830-3a74-41f7-9e23-8cb53be5699f+5:13780:x1869759492761344:12345-192.168.203.27@tcp:13:lfs.0 00002000:00000024:3.0:1783141956.869330:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783141956.869438:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:336df830-3a74-41f7-9e23-8cb53be5699f+5:13780:x1869759492761344:12345-192.168.203.27@tcp:13:lfs.0 Request processed in 157us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141956.869446:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00080000:0.0:1783141956.869941:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141956.877005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141956.878119:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492761472 00000100:00100000:3.0:1783141956.878137:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492761472 00000100:00100000:3.0:1783141956.878382:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:3.0:1783141956.878397:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:336df830-3a74-41f7-9e23-8cb53be5699f+6:13780:x1869759492761472:12345-192.168.203.27@tcp:13:lfs.0 00002000:00000024:3.0:1783141956.878490:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783141956.878699:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783141956.878917:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:336df830-3a74-41f7-9e23-8cb53be5699f+6:13780:x1869759492761472:12345-192.168.203.27@tcp:13:lfs.0 Request processed in 521us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141956.878935:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:2.0:1783141957.097952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141957.098103:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492761600 00000100:00100000:1.0:1783141957.098116:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492761600 00000100:00100000:1.0:1783141957.098193:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 90 00000100:00100000:1.0:1783141957.098204:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+10:13812:x1869759492761600:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783141957.098227:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141957.098251:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2174400/0x279ffa91da899a98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a01dd expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.098313:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2174400/0x279ffa91da899a98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01dd expref: 11 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.098326:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2174400/0x279ffa91da899a98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01dd expref: 11 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.098336:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174400, rc 0) 00000100:00100000:1.0:1783141957.098677:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13812:x1869759492761600:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 206us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141957.098688:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 90 00000100:00100000:1.0:1783141957.110678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141957.110806:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492761728 00000100:00100000:0.0:1783141957.110818:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492761728 00000100:00100000:0.0:1783141957.110889:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 91 00000100:00100000:0.0:1783141957.110901:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13812:x1869759492761728:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783141957.111327:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13812:x1869759492761728:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 425us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141957.111335:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 91 00000100:00100000:2.0:1783141957.119333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141957.119518:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492761856 00000100:00100000:0.0:1783141957.119533:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492761856 00000100:00100000:0.0:1783141957.119737:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 92 00000100:00100000:0.0:1783141957.119750:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13812:x1869759492761856:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783141957.120146:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13812:x1869759492761856:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 398us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141957.120156:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 92 00000100:00100000:2.0:1783141957.128079:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141957.128247:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492761984 00000100:00100000:1.0:1783141957.128260:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492761984 00000100:00100000:1.0:1783141957.128336:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 93 00000100:00100000:1.0:1783141957.128348:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13819:x1869759492761984:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783141957.129434:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13819:x1869759492761984:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 1078us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141957.129447:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 93 00000100:00100000:2.0:1783141957.140522:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141957.141224:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492762112 00000100:00100000:0.0:1783141957.141238:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492762112 00000100:00100000:0.0:1783141957.141327:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00100000:0.0:1783141957.141339:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13819:x1869759492762112:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783141957.141747:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13819:x1869759492762112:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 408us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141957.141756:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 94 00000100:00100000:2.0:1783141957.146726:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141957.146885:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492762240 00000100:00100000:1.0:1783141957.146898:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492762240 00000100:00100000:1.0:1783141957.146971:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 95 00000100:00100000:1.0:1783141957.146982:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13812:x1869759492762240:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783141957.147003:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141957.147028:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175e00/0x279ffa91da899a9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0207 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.147088:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175e00/0x279ffa91da899a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0207 expref: 12 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.147100:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175e00/0x279ffa91da899a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0207 expref: 12 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.147111:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175e00, rc 0) 00000100:00100000:1.0:1783141957.147198:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13812:x1869759492762240:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 216us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141957.147206:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 95 00000100:00100000:0.0:1783141957.159521:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141957.159612:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492762368 00000100:00100000:1.0:1783141957.159625:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492762368 00000100:00100000:1.0:1783141957.159699:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 96 00000100:00100000:1.0:1783141957.159710:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13812:x1869759492762368:12345-192.168.203.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783141957.159742:0:14117:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783141957.159766:0:14117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783141957.159770:0:14117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783141957.159773:0:14117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783141957.159776:0:14117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783141957.168526:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13812:x1869759492762368:12345-192.168.203.27@tcp:256:mount.lustre.0 Request processed in 8806us (9006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141957.168550:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 96 00000100:00100000:0.0:1783141957.175373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141957.175456:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492762496 00000100:00100000:1.0:1783141957.175514:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492762496 00000100:00100000:1.0:1783141957.175715:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 97 00000100:00100000:1.0:1783141957.175727:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13812:x1869759492762496:12345-192.168.203.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783141957.175749:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141957.175771:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a020e expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.175820:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a020e expref: 13 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.175834:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a020e expref: 13 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.175843:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174600, rc 0) 00000100:00100000:1.0:1783141957.175935:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13812:x1869759492762496:12345-192.168.203.27@tcp:101:mount.lustre.0 Request processed in 197us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141957.175943:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 97 00000100:00100000:3.0:1783141957.178216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141957.178276:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492762624 00000100:00100000:2.0:1783141957.178287:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492762624 00000100:00100000:2.0:1783141957.178337:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 98 00000100:00100000:2.0:1783141957.178346:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13812:x1869759492762624:12345-192.168.203.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783141957.178766:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13812:x1869759492762624:12345-192.168.203.27@tcp:501:mount.lustre.0 Request processed in 420us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141957.178773:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 98 00000100:00100000:2.0:1783141957.182801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141957.182860:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492762752 00000100:00100000:1.0:1783141957.182871:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492762752 00000100:00100000:1.0:1783141957.182948:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:1.0:1783141957.182961:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13812:x1869759492762752:12345-192.168.203.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783141957.183415:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13812:x1869759492762752:12345-192.168.203.27@tcp:503:mount.lustre.0 Request processed in 455us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141957.183426:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 99 00000100:00100000:2.0:1783141957.187831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000001:00100000:2.0:1783141957.189872:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 336df830-3a74-41f7-9e23-8cb53be5699f 00000100:00100000:3.0:1783141957.190294:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492762880 00000100:00100000:3.0:1783141957.190305:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492762880 00000100:00100000:0.0:1783141957.190512:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 100 00000100:00100000:0.0:1783141957.190523:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13823:x1869759492762880:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783141957.190848:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13823:x1869759492762880:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 326us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141957.190856:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 100 00000100:00100000:0.0:1783141957.194432:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141957.194754:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492763008 00000100:00100000:1.0:1783141957.194764:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492763008 00000100:00100000:1.0:1783141957.194859:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 101 00000100:00100000:1.0:1783141957.194870:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13823:x1869759492763008:12345-192.168.203.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783141957.195114:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13823:x1869759492763008:12345-192.168.203.27@tcp:502:llog_process_th.0 Request processed in 245us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141957.195121:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 101 00000100:00100000:3.0:1783141957.200843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141957.201024:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492763136 00000100:00100000:2.0:1783141957.201039:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492763136 00000100:00100000:2.0:1783141957.201097:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:2.0:1783141957.201127:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2365:x1869759492763136:12345-192.168.203.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783141957.201167:0:15439:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from caf0c8a4-b162-4255-923a-5fdfd2959d97@192.168.203.27@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1783141957.201219:0:15439:0:(genops.c:1406:class_connect()) connect: client caf0c8a4-b162-4255-923a-5fdfd2959d97, cookie 0x279ffa91da899aad 00000004:00100000:2.0:1783141957.201265:0:15439:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783141957.202122:0:15439:0:(import.c:65:import_set_state_nolock()) ffff9464bfbb6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141957.202279:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:2365:x1869759492763136:12345-192.168.203.27@tcp:38:mount.lustre.0 Request processed in 1151us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141957.202290:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:0.0:1783141957.209202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141957.209254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141957.209663:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492763264 00000100:00100000:3.0:1783141957.209677:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492763264 00000100:00100000:3.0:1783141957.209847:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492763392 00000100:00100000:3.0:1783141957.209852:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492763392 00000100:00080000:0.0:1783141957.209904:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141957.210320:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:2.0:1783141957.210334:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+7:0:x1869759492763264:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783141957.210427:0:14123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783141957.210666:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+7:0:x1869759492763264:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 335us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141957.210674:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:2.0:1783141957.210699:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:2.0:1783141957.210705:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:13812:x1869759492763392:12345-192.168.203.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783141957.210716:0:14123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783141957.210737:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:13812:x1869759492763392:12345-192.168.203.27@tcp:41:mount.lustre.0 Request processed in 33us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141957.210743:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:0.0:1783141957.217149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141957.219138:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492763520 00000100:00100000:2.0:1783141957.219157:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492763520 00000100:00100000:2.0:1783141957.219248:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1783141957.219262:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:13812:x1869759492763520:12345-192.168.203.27@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783141957.219400:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:13812:x1869759492763520:12345-192.168.203.27@tcp:40:mount.lustre.0 Request processed in 141us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141957.219409:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:0.0:1783141957.222760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141957.223889:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492763904 00000100:00100000:1.0:1783141957.223924:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492763904 00000100:00100000:1.0:1783141957.224283:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:1.0:1783141957.224297:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:13812:x1869759492763904:12345-192.168.203.27@tcp:33:mount.lustre.0 00000100:00100000:3.0:1783141957.224342:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141957.224391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141957.224492:0:15612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492763648 00000100:00100000:2.0:1783141957.224496:0:15612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492763648 00000100:00100000:2.0:1783141957.224521:0:15612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492763776 00000100:00100000:2.0:1783141957.224523:0:15612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492763776 00000100:00100000:2.0:1783141957.224537:0:15612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:2.0:1783141957.224542:0:15612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2365:x1869759492763648:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783141957.224570:0:15612:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from caf0c8a4-b162-4255-923a-5fdfd2959d97@192.168.203.27@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1783141957.224619:0:15612:0:(genops.c:1406:class_connect()) connect: client caf0c8a4-b162-4255-923a-5fdfd2959d97, cookie 0x279ffa91da899ab4 00002000:00100000:2.0:1783141957.224635:0:15612:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli caf0c8a4-b162-4255-923a-5fdfd2959d97/ffff9464bfbb1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783141957.224661:0:15612:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783141957.225075:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:3.0:1783141957.225082:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2365:x1869759492763776:12345-192.168.203.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783141957.225103:0:14759:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from caf0c8a4-b162-4255-923a-5fdfd2959d97@192.168.203.27@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:3.0:1783141957.225127:0:14759:0:(genops.c:1406:class_connect()) connect: client caf0c8a4-b162-4255-923a-5fdfd2959d97, cookie 0x279ffa91da899abb 00002000:00100000:3.0:1783141957.225134:0:14759:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli caf0c8a4-b162-4255-923a-5fdfd2959d97/ffff946383526000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113656 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783141957.225141:0:14759:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00200000:1.0:1783141957.225343:0:14127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00002000:00080000:3.0:1783141957.225387:0:14759:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783141957.225432:0:14759:0:(import.c:65:import_set_state_nolock()) ffff946383523800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783141957.225535:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:2365:x1869759492763776:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 450us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141957.225543:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00002000:00080000:2.0:1783141957.225738:0:15612:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1783141957.225745:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:13812:x1869759492763904:12345-192.168.203.27@tcp:33:mount.lustre.0 Request processed in 1450us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141957.225755:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00080000:2.0:1783141957.225819:0:15612:0:(import.c:65:import_set_state_nolock()) ffff9464bfbb0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783141957.225849:0:15612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:2365:x1869759492763648:12345-192.168.203.27@tcp:8:mount.lustre.0 Request processed in 1305us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141957.225856:0:15612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:3.0:1783141957.403435:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141957.406437:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492764032 00000100:00100000:1.0:1783141957.406475:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492764032 00000100:00100000:1.0:1783141957.406574:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:1.0:1783141957.406841:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:13844:x1869759492764032:12345-192.168.203.27@tcp:101:mkdir.0 00010000:00010000:1.0:1783141957.406872:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141957.406903:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899ac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0238 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.406991:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.407008:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.407024:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141957.407346:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783141957.407352:0:14124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141957.407439:0:14124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.407507:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899ac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0238 expref: 8 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.407539:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0238 expref: 7 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141957.407550:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:1.0:1783141957.407553:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783141957.407558:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174000, rc 0) 00000100:00100000:1.0:1783141957.407886:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+7:13844:x1869759492764032:12345-192.168.203.27@tcp:101:mkdir.0 Request processed in 1299us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141957.407895:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00010000:00010000:1.0:1783141957.530682:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141958.562258:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783141959.580756:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783141959.779042:0:5809:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 336df830-3a74-41f7-9e23-8cb53be5699f 00000001:00100000:3.0:1783141959.779062:0:5809:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of caf0c8a4-b162-4255-923a-5fdfd2959d97 00000001:02000400:2.0:1783141959.907383:0:15989:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1783141960.219960:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510576640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141960.219989:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510576768:0@lo:400:kworker.0 00000100:00100000:2.0:1783141960.220029:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510577024:0@lo:400:kworker.0 00000100:00100000:3.0:1783141960.220045:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141960.220046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141960.220065:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141960.220115:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783141960.220127:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510576896:0@lo:400:kworker.0 00000100:00100000:1.0:1783141960.220157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141960.220200:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510576768 00000100:00100000:1.0:1783141960.220207:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510576768 00000100:00100000:1.0:1783141960.220246:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783141960.220253:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3305:x1869759510576768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141960.220300:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3305:x1869759510576768:12345-0@lo:400:kworker.0 Request processed in 46us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141960.220307:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783141960.220350:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510576768:0@lo:400:kworker.0 00000100:00100000:1.0:1783141960.220398:0:15612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510577024 00000100:00100000:1.0:1783141960.220414:0:15612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510577024 00000100:00100000:1.0:1783141960.220448:0:15612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510576896 00000100:00100000:1.0:1783141960.220452:0:15612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510576896 00000100:00100000:1.0:1783141960.220503:0:15612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783141960.220509:0:15612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510577024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141960.220551:0:15612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510577024:12345-0@lo:400:kworker.0 Request processed in 42us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141960.220558:0:15612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783141960.220570:0:15612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783141960.220575:0:15612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510576896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783141960.220617:0:15612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510576896:12345-0@lo:400:kworker.0 Request processed in 42us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141960.220632:0:15612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1783141960.220650:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783141960.220654:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141960.220751:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510576896:0@lo:400:kworker.0 00000100:00100000:1.0:1783141960.220788:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510576640 00000100:00100000:1.0:1783141960.220791:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510576640 00000100:00100000:1.0:1783141960.220814:0:14762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783141960.220820:0:14762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510576640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141960.220846:0:14762:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141960.223470:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510577024:0@lo:400:kworker.0 00000100:00100000:0.0:1783141960.227537:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510577280:0@lo:400:kworker.0 00000100:00100000:0.0:1783141960.227605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141960.227651:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783141960.227658:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510577408:0@lo:400:kworker.0 00000100:00100000:0.0:1783141960.227681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141960.227802:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510577280 00000100:00100000:0.0:1783141960.227811:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510577280 00000100:00100000:0.0:1783141960.227874:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510577408 00000100:00100000:0.0:1783141960.227878:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510577408 00000100:00100000:0.0:1783141960.227914:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141960.227923:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510577280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141960.227974:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510577280:12345-0@lo:400:kworker.0 Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141960.228004:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783141960.228021:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783141960.228026:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510577408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141960.228062:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1869759510577408:12345-0@lo:400:kworker.0 Request processed in 36us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141960.228074:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1783141960.228099:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141960.228132:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1869759510577408:0@lo:400:kworker.0 00000100:00100000:3.0:1783141960.228192:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946496b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510577152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783141960.228226:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510577280:0@lo:400:kworker.0 00000100:00100000:3.0:1783141960.228239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141960.228262:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510577536:0@lo:400:kworker.0 00000100:00100000:0.0:1783141960.228300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141960.228324:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510577536 00000100:00100000:0.0:1783141960.228327:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510577536 00000100:00100000:0.0:1783141960.228353:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783141960.228358:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510577536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141960.228395:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1869759510577536:12345-0@lo:400:kworker.0 Request processed in 37us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141960.228401:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1783141960.228421:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783141960.228437:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1869759510577536:0@lo:400:kworker.0 00000100:00100000:0.0:1783141960.231605:0:14763:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1783141960.231636:0:14763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1783141960.231757:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510577152 00000100:00100000:0.0:1783141960.231767:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510577152 00000100:00100000:0.0:1783141960.232157:0:16001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783141960.232179:0:16001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510577152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783141960.232217:0:16001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783141960.232297:0:16001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510577152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (4058us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141960.232305:0:16001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783141960.234107:0:14762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510576640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13280us (14060us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141960.234119:0:14762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141960.235202:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510576640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783141960.235239:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946496b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510577152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783141960.602751:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783141960.769411:0:6610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of caf0c8a4-b162-4255-923a-5fdfd2959d97 00010000:00010000:0.0:1783141961.626741:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783141962.326116:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of caf0c8a4-b162-4255-923a-5fdfd2959d97 00000100:00100000:2.0:1783141962.462081:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141962.462149:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141962.462194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141962.462219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141962.462240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141962.462259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141962.462286:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141962.462318:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492764672 00000100:00100000:2.0:1783141962.462330:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492764672 00000100:00100000:2.0:1783141962.462408:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492764288 00000100:00100000:2.0:1783141962.462412:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492764288 00000100:00100000:2.0:1783141962.462439:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1783141962.462449:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:2366:x1869759492764672:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141962.462524:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492764160 00000100:00100000:3.0:1783141962.462529:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492764160 00000100:00100000:2.0:1783141962.462560:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:2366:x1869759492764672:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 111us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141962.462562:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 103 00000100:00100000:2.0:1783141962.462569:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:3.0:1783141962.462570:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:2366:x1869759492764160:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141962.462589:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:2.0:1783141962.462595:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+6:2366:x1869759492764288:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1783141962.462598:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:2366:x1869759492764160:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141962.462615:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 103 00000100:00100000:2.0:1783141962.462631:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+6:2366:x1869759492764288:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 36us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141962.462636:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:2.0:1783141962.462655:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492764416 00000100:00100000:2.0:1783141962.462658:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492764416 00000100:00100000:2.0:1783141962.462678:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492764928 00000100:00100000:2.0:1783141962.462680:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492764928 00000100:00100000:2.0:1783141962.462693:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492764544 00000100:00100000:2.0:1783141962.462695:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492764544 00000100:00100000:2.0:1783141962.462706:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492764800 00000100:00100000:2.0:1783141962.462707:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492764800 00000100:00100000:0.0:1783141962.464157:0:15612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:0.0:1783141962.464181:0:15612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:336df830-3a74-41f7-9e23-8cb53be5699f+5:2366:x1869759492764416:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141962.464261:0:15612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:336df830-3a74-41f7-9e23-8cb53be5699f+5:2366:x1869759492764416:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 90us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141962.464270:0:15612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:0.0:1783141962.464294:0:15612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:0.0:1783141962.464302:0:15612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:2366:x1869759492764928:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141962.464328:0:15612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:2366:x1869759492764928:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141962.464335:0:15612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:0.0:1783141962.464346:0:15612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:0.0:1783141962.464373:0:15612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:336df830-3a74-41f7-9e23-8cb53be5699f+5:2366:x1869759492764544:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1783141962.464402:0:15612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:336df830-3a74-41f7-9e23-8cb53be5699f+5:2366:x1869759492764544:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 49us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141962.464408:0:15612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:2.0:1783141962.465898:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:2.0:1783141962.465909:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:2366:x1869759492764800:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141962.465978:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:2366:x1869759492764800:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 70us (3689us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141962.465985:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00080000:2.0:1783141962.466013:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141962.466018:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783141962.466021:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783141962.651746:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783141962.891820:0:16142:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedf5b3950 20000000:00000080:2.0:1783141962.891841:0:16142:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9464836dc000 uarg=0000000000000000 20000000:01000000:2.0:1783141962.891887:0:16142:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783141962.891894:0:16142:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783141962.891900:0:16142:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783141962.892940:0:16143:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1783141962.893122:0:16142:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783141962.899651:0:16142:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783141962.899856:0:16142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.899882:0:16142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da8997c0 expref: 18 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.899890:0:16142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89980d expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.899898:0:16142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da89987d expref: 18 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.899910:0:16142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01ac expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.899943:0:16142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a020e expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.899953:0:16142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.900010:0:16142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a020e expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.900027:0:16142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a020e expref: 12 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141962.900045:0:16142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba630e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510577664:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141962.900185:0:16142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01ac expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.900193:0:16142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01ac expref: 12 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141962.900203:0:16142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba633b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510577792:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141962.900235:0:16142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da89987d expref: 18 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.900244:0:16142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da89987d expref: 18 pid: 14115 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141962.900253:0:16142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba630380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510577920:0@lo:104: 00000100:00100000:2.0:1783141962.900301:0:16142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141962.900356:0:16142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da89980d expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.900365:0:16142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da89980d expref: 18 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141962.900374:0:16142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba630700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510578048:0@lo:104: 00000100:00100000:2.0:1783141962.900397:0:16142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141962.900426:0:16142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x279ffa91da8997c0 expref: 18 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.900434:0:16142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x279ffa91da8997c0 expref: 18 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141962.900442:0:16142:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510578176:0@lo:104: 00000100:00100000:1.0:1783141962.900810:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510577920 00000100:00100000:1.0:1783141962.900820:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510577920 00000100:00100000:1.0:1783141962.900873:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510578048 00000100:00100000:1.0:1783141962.900877:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510578048 00000100:00100000:1.0:1783141962.900893:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783141962.900902:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+4:16142:x1869759510577920:12345-0@lo:104: 00010000:00010000:1.0:1783141962.900919:0:14107:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141962.905356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141962.905509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141962.905572:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492765056 00000100:00100000:0.0:1783141962.905582:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492765056 00010000:00010000:0.0:1783141962.905641:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a020e expref: 13 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141962.905686:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492765184 00000100:00100000:0.0:1783141962.905690:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492765184 00010000:00010000:0.0:1783141962.905704:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01ac expref: 14 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141962.905720:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:0.0:1783141962.905729:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+14:2369:x1869759492765056:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141962.905747:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141962.905753:0:14110:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a020e expref: 14 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141962.905768:0:14110:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a020e expref: 14 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141962.905791:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141962.905855:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+14:2369:x1869759492765056:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 126us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141962.905863:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:0.0:1783141962.905883:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:0.0:1783141962.905890:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:2369:x1869759492765184:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783141962.905899:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141962.905904:0:14110:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01ac expref: 13 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141962.905924:0:14110:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01ac expref: 13 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141962.905933:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141962.905952:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:2369:x1869759492765184:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 63us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141962.905959:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00010000:00010000:1.0:1783141962.907544:0:14107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783141962.907563:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+4:16142:x1869759510577920:12345-0@lo:104: Request processed in 6657us (7258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141962.907574:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783141962.907618:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783141962.907631:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:16142:x1869759510578048:12345-0@lo:104: 00010000:00010000:1.0:1783141962.907650:0:14107:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141962.907908:0:16142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141962.908034:0:16142:0:(client.c:2701:ptlrpc_set_wait()) set ffff946482f34780 going to sleep for 11 seconds 00010000:00010000:2.0:1783141962.908070:0:16142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2174600/0x279ffa91da899aa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a020e expref: 12 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141962.908089:0:16142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba630e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510577664:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141962.908103:0:16142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464c2174200/0x279ffa91da899a6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01ac expref: 11 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141962.908111:0:16142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba633b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510577792:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141962.908121:0:16142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba630380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510577920:0@lo:104: 00000100:00100000:2.0:1783141962.908129:0:16142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba630700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510578048:0@lo:104: 00000100:00100000:0.0:1783141962.908273:0:14106:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783141962.908291:0:14106:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1783141962.908297:0:14106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1783141962.908741:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783141962.908751:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.908762:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:3.0:1783141962.908766:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.908776:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141962.908784:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141962.908790:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783141962.908847:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.908854:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141962.908881:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.908908:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff946496f52400/0x279ffa91da89987d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da899884 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.908921:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141962.908924:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.908929:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6400 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:3.0:1783141962.908933:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.908939:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141962.908945:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141962.908950:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783141962.908967:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.908972:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141962.908989:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.908996:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff94649d0d6400/0x279ffa91da89980d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da899814 expref: -99 pid: 14757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.909004:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141962.909012:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141962.909014:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141962.909033:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3308:1869759510578304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141962.909091:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141962.909148:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510578432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141962.909172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141962.909213:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510578304 00000100:00100000:3.0:1783141962.909220:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510578304 00010000:00010000:3.0:1783141962.909250:0:14109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89987d expref: 19 pid: 14115 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141962.909276:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510578432 00000100:00100000:3.0:1783141962.909279:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510578432 00010000:00010000:3.0:1783141962.909291:0:14109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89980d expref: 20 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141962.909305:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141962.909313:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfe31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+20:3308:x1869759510578304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141962.909327:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141962.909333:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89987d expref: 20 pid: 14115 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.909344:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da89987d expref: 20 pid: 14115 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.909360:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a1200/0x279ffa91da899884 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da89987d expref: 20 pid: 14115 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.909373:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141962.909407:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfe31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3308:x1869759510578304:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141962.909422:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783141962.909516:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141962.909524:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:3305:x1869759510578432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783141962.909532:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141962.909537:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da89980d expref: 18 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.909546:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da89980d expref: 18 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.909557:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899814 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da89980d expref: 18 pid: 14116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.909565:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141962.909592:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:3305:x1869759510578432:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141962.909608:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783141962.909644:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3305:1869759510578432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141962.909671:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3308:1869759510578304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783141962.910142:0:14107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1783141962.910153:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:16142:x1869759510578048:12345-0@lo:104: Request processed in 2525us (9753us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141962.910162:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783141962.910182:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510578176 00000100:00100000:1.0:1783141962.910187:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510578176 00000100:00100000:1.0:1783141962.910207:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783141962.910213:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464b9d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:16142:x1869759510578176:12345-0@lo:104: 00010000:00010000:1.0:1783141962.910224:0:14107:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141962.910327:0:16142:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16142:1869759510578176:0@lo:104: 00010000:00010000:3.0:1783141962.910358:0:16142:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141962.912716:0:14107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783141962.912760:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464b9d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+3:16142:x1869759510578176:12345-0@lo:104: Request processed in 2539us (4844us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141962.912775:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783141962.912983:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783141962.912993:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.913016:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc1d57c20) 10000000:00010000:3.0:1783141962.913021:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.913034:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783141962.913042:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141962.913047:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783141962.913109:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.913117:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783141962.913142:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.913150:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.127@tcp lock: ffff94649d0d7600/0x279ffa91da8997c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x279ffa91da8997c7 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141962.913173:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141962.913175:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783141962.913177:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141962.913195:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3306:1869759510578560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783141962.913277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783141962.913412:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141962.913514:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510578560 00000100:00100000:2.0:1783141962.913531:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510578560 00010000:00010000:2.0:1783141962.913569:0:14109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8997c0 expref: 17 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141962.913608:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141962.913619:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:3306:x1869759510578560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783141962.913637:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141962.913643:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x279ffa91da8997c0 expref: 17 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913657:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x279ffa91da8997c0 expref: 17 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913681:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464b25a0e00/0x279ffa91da8997c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x279ffa91da8997c0 expref: 17 pid: 14117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913697:0:14109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913707:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913726:0:14109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913733:0:14109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913740:0:14109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913746:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913759:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141962.913764:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913772:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913787:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913798:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141962.913837:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:3306:x1869759510578560:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141962.913843:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1783141962.913887:0:16142:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913895:0:16142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141962.913901:0:16142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9464bbd7a800/0x279ffa91da899ad0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141962.918577:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3306:1869759510578560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783141963.674583:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783141963.992640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141963.992687:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492765312 00000100:00100000:3.0:1783141963.992697:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492765312 00000100:00100000:3.0:1783141963.992756:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:3.0:1783141963.992766:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+11:13698:x1869759492765312:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141963.992782:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141963.992801:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464bfe17000/0x279ffa91da899ad7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a023f expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141963.992827:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464bfe17000/0x279ffa91da899ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a023f expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141963.992838:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464bfe17000/0x279ffa91da899ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a023f expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141963.992848:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17000, rc 0) 00000100:00100000:3.0:1783141963.992902:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13698:x1869759492765312:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 137us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141963.992910:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 104 00000100:00100000:3.0:1783141964.001437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141964.001485:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492765440 00000100:00100000:3.0:1783141964.001495:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492765440 00000100:00100000:3.0:1783141964.001634:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:3.0:1783141964.001644:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13698:x1869759492765440:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.002423:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13698:x1869759492765440:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 778us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141964.002432:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 105 00000100:00100000:3.0:1783141964.007205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141964.007239:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492765568 00000100:00100000:3.0:1783141964.007248:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492765568 00000100:00100000:3.0:1783141964.007285:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 106 00000100:00100000:3.0:1783141964.007294:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13698:x1869759492765568:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.008174:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13698:x1869759492765568:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 878us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141964.008183:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 106 00000100:00100000:0.0:1783141964.022851:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141964.023124:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492765696 00000100:00100000:3.0:1783141964.023133:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492765696 00000100:00100000:3.0:1783141964.023186:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 107 00000100:00100000:3.0:1783141964.023197:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+12:13698:x1869759492765696:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141964.023214:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141964.023231:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899ade lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0246 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.023259:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0246 expref: 13 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.023271:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464bfe17c00/0x279ffa91da899ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0246 expref: 13 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.023280:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17c00, rc 0) 00000100:00100000:3.0:1783141964.023338:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13698:x1869759492765696:12345-192.168.203.27@tcp:101:ll_cfg_requeue.0 Request processed in 143us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141964.023347:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 107 00000100:00100000:3.0:1783141964.033880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141964.034251:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492765824 00000100:00100000:1.0:1783141964.034261:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492765824 00000100:00100000:1.0:1783141964.034314:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 108 00000100:00100000:1.0:1783141964.034324:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13698:x1869759492765824:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141964.034634:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13698:x1869759492765824:12345-192.168.203.27@tcp:501:ll_cfg_requeue.0 Request processed in 307us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141964.034643:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 108 00000100:00100000:2.0:1783141964.038859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141964.038928:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492765952 00000100:00100000:3.0:1783141964.038944:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492765952 00000100:00100000:3.0:1783141964.038998:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 109 00000100:00100000:3.0:1783141964.039008:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13698:x1869759492765952:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.039212:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:13698:x1869759492765952:12345-192.168.203.27@tcp:503:ll_cfg_requeue.0 Request processed in 204us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141964.039220:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 109 10000000:01000000:3.0:1783141964.507701:0:14119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783141964.507707:0:14119:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9464830bb000 from 10 10000000:01000000:3.0:1783141964.507711:0:14119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783141964.507757:0:14119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17400/0x279ffa91da899ae5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.507769:0:14119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464bfe17400/0x279ffa91da899ae5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.507780:0:14119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464bfe17400/0x279ffa91da899ae5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141964.507805:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510578688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.507869:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141964.507907:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141964.508303:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510578688 00000100:00100000:0.0:1783141964.508310:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510578688 00000100:00100000:0.0:1783141964.508356:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783141964.508364:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+16:14119:x1869759510578688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141964.508457:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141964.508498:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94649d0d6600/0x279ffa91da899aec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da899ae5 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141964.508521:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94649d0d6600/0x279ffa91da899aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da899ae5 expref: 17 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141964.508531:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94649d0d6600/0x279ffa91da899aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899ae5 expref: 17 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141964.508541:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6600, rc 0) 00000100:00100000:0.0:1783141964.508585:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:14119:x1869759510578688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141964.508608:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783141964.508637:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510578688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783141964.508654:0:14119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464bfe17400/0x279ffa91da899ae5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899aec expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.508663:0:14119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464bfe17400/0x279ffa91da899ae5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da899aec expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141964.508712:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510578816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.508745:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141964.508768:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899780 going to sleep for 11 seconds 00000100:00100000:1.0:1783141964.508833:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510578816 00000100:00100000:1.0:1783141964.508839:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510578816 00000100:00100000:1.0:1783141964.508876:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783141964.508884:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:14119:x1869759510578816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783141964.509118:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:14119:x1869759510578816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141964.509125:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783141964.509185:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510578816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.509213:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510578944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.509250:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141964.509269:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899780 going to sleep for 11 seconds 00000100:00100000:0.0:1783141964.509541:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510578944 00000100:00100000:0.0:1783141964.509546:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510578944 00000100:00100000:0.0:1783141964.509575:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783141964.509581:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:14119:x1869759510578944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141964.510555:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:14119:x1869759510578944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 971us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141964.510565:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783141964.510575:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510578944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783141964.515444:0:16240:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783141964.515769:0:14119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783141964.515787:0:14119:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783141964.515807:0:14119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe17400/0x279ffa91da899ae5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899aec expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.515819:0:14119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe17400/0x279ffa91da899ae5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899aec expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141964.515829:0:14119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783141964.515832:0:14119:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff946496822800 from 10 10000000:01000000:3.0:1783141964.515834:0:14119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783141964.515879:0:14119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16200/0x279ffa91da899af3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.515888:0:14119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464bfe16200/0x279ffa91da899af3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.515899:0:14119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464bfe16200/0x279ffa91da899af3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141964.515924:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.516000:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141964.516043:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141964.516554:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510579072 00000100:00100000:1.0:1783141964.516561:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510579072 00000100:00100000:1.0:1783141964.516613:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783141964.516622:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464973ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+17:14119:x1869759510579072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141964.516635:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141964.516647:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175c00/0x279ffa91da899afa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da899af3 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141964.516681:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175c00/0x279ffa91da899afa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da899af3 expref: 18 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141964.516691:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175c00/0x279ffa91da899afa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899af3 expref: 18 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141964.516700:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175c00, rc 0) 00000100:00100000:1.0:1783141964.516762:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464973ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:14119:x1869759510579072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141964.516770:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783141964.516852:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783141964.516869:0:14119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464bfe16200/0x279ffa91da899af3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899afa expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141964.516877:0:14119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464bfe16200/0x279ffa91da899af3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da899afa expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141964.516931:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141964.516958:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141964.516990:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464ba592e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783141964.517037:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510579200 00000100:00100000:3.0:1783141964.517042:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510579200 00000100:00100000:3.0:1783141964.517067:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783141964.517074:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:14119:x1869759510579200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.518647:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:14119:x1869759510579200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1568us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141964.518658:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783141964.520105:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783141964.520159:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783141964.520214:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141964.520254:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464ba592e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783141964.520575:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510579328 00000100:00100000:1.0:1783141964.520583:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510579328 00000100:00100000:1.0:1783141964.520641:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783141964.520716:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:14119:x1869759510579328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783141964.523694:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:14119:x1869759510579328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3038us (3472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141964.523708:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783141964.523973:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783141964.525033:0:16242:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783141964.525183:0:14119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783141964.525203:0:14119:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783141964.525214:0:14119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16200/0x279ffa91da899af3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899afa expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.525225:0:14119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe16200/0x279ffa91da899af3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899afa expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783141964.525235:0:14119:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783141964.525238:0:14119:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9464bb12d800 from 10 10000000:01000000:3.0:1783141964.525240:0:14119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783141964.525271:0:14119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16a00/0x279ffa91da899b01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.525279:0:14119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.127@tcp lock: ffff9464bfe16a00/0x279ffa91da899b01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.525290:0:14119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.127@tcp lock: ffff9464bfe16a00/0x279ffa91da899b01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141964.525317:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946482f4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.525372:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783141964.525446:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946486899240 going to sleep for 11 seconds 00000100:00100000:1.0:1783141964.525598:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510579456 00000100:00100000:1.0:1783141964.525603:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510579456 00000100:00100000:1.0:1783141964.525672:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783141964.525682:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+18:14119:x1869759510579456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783141964.525694:0:14115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141964.525707:0:14115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9464c2175400/0x279ffa91da899b08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x279ffa91da899b01 expref: -99 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141964.525729:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9464c2175400/0x279ffa91da899b08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x279ffa91da899b01 expref: 19 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141964.525746:0:14115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9464c2175400/0x279ffa91da899b08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x279ffa91da899b01 expref: 19 pid: 14115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141964.525755:0:14115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175400, rc 0) 00000100:00100000:1.0:1783141964.525797:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:14119:x1869759510579456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141964.525804:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783141964.525866:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946482f4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783141964.525879:0:14119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.127@tcp lock: ffff9464bfe16a00/0x279ffa91da899b01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899b08 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141964.525888:0:14119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.127@tcp lock: ffff9464bfe16a00/0x279ffa91da899b01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x279ffa91da899b08 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141964.525942:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141964.525965:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141964.526039:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946482f34300 going to sleep for 11 seconds 00000100:00100000:3.0:1783141964.526085:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510579584 00000100:00100000:3.0:1783141964.526090:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510579584 00000100:00100000:3.0:1783141964.526112:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783141964.526118:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:14119:x1869759510579584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.526375:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:14119:x1869759510579584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141964.526383:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783141964.526538:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783141964.526567:0:14119:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783141964.526614:0:14119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141964.526671:0:14119:0:(client.c:2701:ptlrpc_set_wait()) set ffff946482f34300 going to sleep for 11 seconds 00000100:00100000:3.0:1783141964.526704:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510579712 00000100:00100000:3.0:1783141964.526708:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510579712 00000100:00100000:3.0:1783141964.526762:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783141964.526768:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:14119:x1869759510579712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783141964.526890:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:14119:x1869759510579712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141964.526897:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783141964.526999:0:14119:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba632d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:14119:1869759510579712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783141964.527801:0:16243:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783141964.527933:0:14119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783141964.527960:0:14119:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783141964.527968:0:14119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.127@tcp lock: ffff9464bfe16a00/0x279ffa91da899b01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899b08 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141964.527978:0:14119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.127@tcp lock: ffff9464bfe16a00/0x279ffa91da899b01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x279ffa91da899b08 expref: -99 pid: 14119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141964.699647:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141965.338742:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510580096:0@lo:400:kworker.0 00000100:00100000:2.0:1783141965.338810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141965.338876:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783141965.338882:0:3305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510580224:0@lo:400:kworker.0 00000100:00100000:2.0:1783141965.338904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141965.339026:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510580096 00000100:00100000:0.0:1783141965.339033:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510580096 00000100:00100000:0.0:1783141965.339084:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783141965.339104:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510580096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141965.339167:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1869759510580096:12345-0@lo:400:kworker.0 Request processed in 64us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141965.339174:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1783141965.339210:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783141965.339305:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510580224 00000100:00100000:2.0:1783141965.339310:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510580224 00000100:00100000:2.0:1783141965.339345:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783141965.339357:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510580224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141965.339390:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1869759510580224:12345-0@lo:400:kworker.0 Request processed in 40us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141965.339395:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783141965.339429:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1869759510580224:0@lo:400:kworker.0 00000100:00100000:2.0:1783141965.339438:0:3305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1869759510580096:0@lo:400:kworker.0 00000100:00100000:1.0:1783141965.339609:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510579968:0@lo:400:kworker.0 00000100:00100000:1.0:1783141965.339642:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141965.339669:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510580480:0@lo:400:kworker.0 00000100:00100000:1.0:1783141965.339693:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141965.339708:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783141965.339713:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3308:1869759510579840:0@lo:400:kworker.0 00000100:00100000:1.0:1783141965.339737:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141965.339757:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510580352:0@lo:400:kworker.0 00000100:00100000:1.0:1783141965.339776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783141965.339844:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510580480 00000100:00100000:0.0:1783141965.339849:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510580480 00000100:00100000:0.0:1783141965.339883:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510580352 00000100:00100000:0.0:1783141965.339886:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510580352 00000100:00100000:0.0:1783141965.339900:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141965.339905:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510580480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141965.339952:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1869759510580480:12345-0@lo:400:kworker.0 Request processed in 46us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141965.339958:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783141965.339970:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141965.339976:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510580352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783141965.340003:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1869759510580352:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141965.340009:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783141965.340035:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1869759510580352:0@lo:400:kworker.0 00000100:00100000:0.0:1783141965.340044:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1869759510580480:0@lo:400:kworker.0 00000100:00080000:1.0:1783141965.340210:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783141965.340381:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783141965.340389:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510580608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783141965.340417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141965.340580:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510579968 00000100:00100000:2.0:1783141965.340594:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510579968 00000100:00100000:2.0:1783141965.340635:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141965.340643:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510579968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141965.340681:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1869759510579968:12345-0@lo:400:kworker.0 Request processed in 39us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141965.340686:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141965.340706:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510579840 00000100:00100000:2.0:1783141965.340709:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510579840 00000100:00100000:2.0:1783141965.340729:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783141965.340733:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94638136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3308:x1869759510579840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783141965.340758:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94638136a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55+19:3308:x1869759510579840:12345-0@lo:400:kworker.0 Request processed in 24us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141965.340763:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783141965.340797:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe3ef99-38c6-4ef4-90e3-d4df99cf8e55:3308:1869759510579840:0@lo:400:kworker.0 00000100:00100000:2.0:1783141965.340807:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1869759510579968:0@lo:400:kworker.0 00000100:00100000:3.0:1783141965.341019:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510580736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141965.341057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783141965.341112:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783141965.341145:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510580608 00000100:00100000:1.0:1783141965.341151:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510580608 00000100:00100000:1.0:1783141965.341175:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510580736 00000100:00100000:1.0:1783141965.341178:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510580736 00000100:00100000:1.0:1783141965.341198:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783141965.341204:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510580608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783141965.341232:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783141965.341292:0:16001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783141965.341301:0:16001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510580736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783141965.341319:0:16001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783141965.345118:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510580608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3904us (4691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141965.345145:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783141965.349200:0:16001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1869759510580736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7822us (8063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141965.349215:0:16001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783141965.349275:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510580736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783141965.349295:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1869759510580608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783141965.722852:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783141965.729946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141965.730094:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492766080 00000100:00100000:2.0:1783141965.730109:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492766080 00000100:00100000:2.0:1783141965.730201:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:2.0:1783141965.730227:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+6:14354:x1869759492766080:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141965.730248:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141965.730271:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b800/0x279ffa91da899b0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a024d expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.730345:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.730358:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.730372:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.730390:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.730397:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.730404:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.730892:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ac00/0x279ffa91da899b24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.730901:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ac00/0x279ffa91da899b24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.730909:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ac00/0x279ffa91da899b24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141965.731016:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783141965.731021:0:14124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141965.731111:0:14124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ac00/0x279ffa91da899b24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731121:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731127:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731132:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731138:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7ae00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141965.731141:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731147:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731159:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:2.0:1783141965.731162:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141965.731166:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731170:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731183:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731196:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731202:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731206:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141965.731209:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731215:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731222:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9464a18ebb00) 00010000:00010000:2.0:1783141965.731225:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783141965.731227:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731233:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731267:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b800/0x279ffa91da899b0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a024d expref: 8 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731280:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ac00/0x279ffa91da899b24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a024d expref: 7 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.731287:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9464a18eba00) 00010000:00010000:2.0:1783141965.731289:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141965.731298:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bbd7ac00, rc 0) 00000100:00100000:2.0:1783141965.731371:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+7:14354:x1869759492766080:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1146us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141965.731379:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00080000:1.0:1783141965.731485:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141965.739608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141965.739798:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492766336 00000100:00100000:0.0:1783141965.739812:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492766336 00000100:00100000:0.0:1783141965.739890:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:0.0:1783141965.739902:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+7:14354:x1869759492766336:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141965.739949:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141965.739975:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899b2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0254 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.740076:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.740092:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.740104:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.743926:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.743949:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.743964:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.745167:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899b40 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.745183:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899b40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.745193:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899b40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141965.745206:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783141965.745512:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.745521:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.745528:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.745535:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6400 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141965.745539:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.745547:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.745560:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9464a18eba00) 00010000:00010000:0.0:1783141965.745563:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141965.745568:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.745574:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.747913:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.747927:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.747935:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.747958:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141965.747963:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.747971:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.747985:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94648a1ad500) 00010000:00010000:0.0:1783141965.747988:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141965.747992:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.747998:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.749151:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7600/0x279ffa91da899b2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0254 expref: 10 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.749174:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6a00/0x279ffa91da899b40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0254 expref: 9 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.749182:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648a1ad100) 00010000:00010000:0.0:1783141965.749185:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141965.749188:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6a00, rc 0) 00000100:00100000:0.0:1783141965.749253:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+9:14354:x1869759492766336:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 9352us (9670us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783141965.749262:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:3.0:1783141965.759314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141965.759426:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492766464 00000100:00100000:2.0:1783141965.759442:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492766464 00000100:00100000:2.0:1783141965.759740:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:2.0:1783141965.759751:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+9:14354:x1869759492766464:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783141965.761056:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+9:14354:x1869759492766464:12345-192.168.203.27@tcp:59:lhsmtool_posix.0 Request processed in 1301us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141965.761067:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 17 00000100:00100000:3.0:1783141965.800874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141965.802183:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492766592 00000100:00100000:2.0:1783141965.802196:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492766592 00000100:00100000:2.0:1783141965.802275:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:2.0:1783141965.802286:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+9:14360:x1869759492766592:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141965.802306:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141965.802324:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b800/0x279ffa91da899b4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a025b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.802397:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.802413:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.802426:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.802504:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.802513:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.802521:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804380:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804396:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804404:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804411:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141965.804416:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804424:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804443:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141965.804447:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141965.804452:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804489:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a000/0x279ffa91da899b55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804507:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804520:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804527:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804533:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7ae00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141965.804536:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804543:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804551:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9464a18eb000) 00010000:00010000:3.0:1783141965.804554:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141965.804558:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804565:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7ae00/0x279ffa91da899b5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804843:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b800/0x279ffa91da899b4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a025b expref: 10 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804857:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141965.804859:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141965.804864:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b800/0x279ffa91da899b4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a025b expref: 10 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.804887:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bbd7b800, rc 0) 00000100:00100000:3.0:1783141965.804969:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+9:14360:x1869759492766592:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2684us (4109us total) trans 0 rc 301/301 00000100:00100000:3.0:1783141965.804979:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 18 00000100:00100000:3.0:1783141965.817799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141965.818110:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492766720 00000100:00100000:2.0:1783141965.818123:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492766720 00000100:00100000:2.0:1783141965.818190:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:2.0:1783141965.818203:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:336df830-3a74-41f7-9e23-8cb53be5699f+9:14360:x1869759492766720:12345-192.168.203.27@tcp:700:lfs.0 00000100:00100000:2.0:1783141965.818385:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:336df830-3a74-41f7-9e23-8cb53be5699f+9:14360:x1869759492766720:12345-192.168.203.27@tcp:700:lfs.0 Request processed in 184us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141965.818394:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:2.0:1783141965.822076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141965.822212:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492766976 00000100:00100000:0.0:1783141965.822245:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492766976 00000100:00100000:0.0:1783141965.822411:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00100000:0.0:1783141965.822424:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+9:14360:x1869759492766976:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:0.0:1783141965.822560:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141965.822605:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899a91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a01d6 expref: 9 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.822630:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141965.822637:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141965.822989:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.823007:0:14124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0238 expref: 5 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.823016:0:14124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.823057:0:14124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0238 expref: 5 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.823073:0:14124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0238 expref: 5 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141965.823090:0:14124:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14124:1869759510580864:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141965.823221:0:14124:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464ba592180 going to sleep for 11 seconds 00000100:00100000:2.0:1783141965.826258:0:14124:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14124:1869759510580864:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141965.826368:0:14124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141965.828211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141965.828921:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492767104 00000100:00100000:3.0:1783141965.828935:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492767104 00010000:00010000:3.0:1783141965.829013:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0238 expref: 6 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141965.829059:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:3.0:1783141965.829070:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:2367:x1869759492767104:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141965.829089:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141965.829097:0:14110:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0238 expref: 6 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.829112:0:14110:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0238 expref: 6 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.829140:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ac9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0238 expref: 6 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.829159:0:14110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141965.829165:0:14110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.829197:0:14110:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.829206:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.829249:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141965.829372:0:14124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.829393:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.829421:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.829432:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.829441:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141965.831054:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783141965.831075:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.831085:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.831093:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.831099:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141965.831105:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.831114:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.831131:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141965.831135:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141965.831148:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.831155:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b63 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141965.831180:0:14124:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5c8e379 reply state 00000000fccda3c5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141965.831190:0:14124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783141965.831324:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+10:14360:x1869759492766976:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 8898us (9257us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783141965.831334:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 19 00000100:00080000:1.0:1783141965.832845:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783141965.833107:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:2367:x1869759492767104:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 4028us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141965.833123:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00010000:00010000:1.0:1783141965.840157:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141965.840181:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141965.840190:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141965.840197:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141965.840202:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141965.840212:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141965.840235:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94648a1ad500) 00010000:00010000:1.0:1783141965.840239:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141965.840245:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141965.840251:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899b6a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141965.923991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141965.924102:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492767232 00000100:00100000:0.0:1783141965.924114:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492767232 00000100:00100000:0.0:1783141965.924187:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:0.0:1783141965.924199:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+9:14368:x1869759492767232:12345-192.168.203.27@tcp:101:lctl.0 00010000:00010000:0.0:1783141965.924230:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141965.924261:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0262 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.924410:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.924427:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.924439:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141965.924770:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783141965.924796:0:14123:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141965.924849:0:14123:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.924882:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0262 expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.924905:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6400/0x279ffa91da899b78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0262 expref: 10 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.924915:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141965.924919:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141965.924923:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6400, rc 0) 00000100:00100000:0.0:1783141965.925000:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+10:14368:x1869759492767232:12345-192.168.203.27@tcp:101:lctl.0 Request processed in 803us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141965.925008:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 20 00000100:00100000:0.0:1783141965.947002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141965.947121:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492767360 00000100:00100000:2.0:1783141965.947135:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492767360 00000100:00100000:2.0:1783141965.947209:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:2.0:1783141965.947221:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:14369:x1869759492767360:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141965.947268:0:15439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141965.947302:0:15439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899b7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0269 expref: -99 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.947386:0:15439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b400/0x279ffa91da899b86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.947403:0:15439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b400/0x279ffa91da899b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.947416:0:15439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b400/0x279ffa91da899b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141965.947551:0:15439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783141965.947555:0:15439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141965.947601:0:15439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b400/0x279ffa91da899b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.947631:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899b7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0269 expref: 7 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.947654:0:15439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b400/0x279ffa91da899b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0269 expref: 6 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.947664:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:2.0:1783141965.947667:0:15439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141965.947672:0:15439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bbd7b400, rc 0) 00000100:00100000:2.0:1783141965.947752:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:14369:x1869759492767360:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 533us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141965.947760:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:1.0:1783141965.950876:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141965.951098:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492767488 00000100:00100000:0.0:1783141965.951112:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492767488 00000100:00100000:0.0:1783141965.951226:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:0.0:1783141965.951239:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:14369:x1869759492767488:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1783141965.951266:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141965.951299:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0270 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.951382:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.951400:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.951430:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.951451:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.951509:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.951518:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.954397:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899ba2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.954420:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.954433:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141965.954517:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783141965.954522:0:14123:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141965.954548:0:14123:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.954561:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.954568:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.954796:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.954973:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141965.954978:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.954986:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.954999:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141965.955003:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141965.955007:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955014:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955033:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955039:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955044:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955049:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141965.955052:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955068:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955077:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94648a1ad800) 00010000:00010000:0.0:1783141965.955079:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141965.955082:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955087:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899b9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955132:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899b8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0270 expref: 8 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955146:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0270 expref: 7 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.955369:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94648a1ad500) 00010000:00010000:0.0:1783141965.955372:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783141965.955374:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6e00, rc 0) 00000100:00100000:0.0:1783141965.955482:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+7:14369:x1869759492767488:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 4220us (4594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141965.955491:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:3.0:1783141965.960377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141965.961302:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492767744 00000100:00100000:2.0:1783141965.961318:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492767744 00000100:00100000:2.0:1783141965.961473:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:2.0:1783141965.961498:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+7:14369:x1869759492767744:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141965.961526:0:15439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141965.961785:0:15439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899ba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0277 expref: -99 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141965.961950:0:15439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783141965.962106:0:15439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899ba9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0277 expref: 9 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.962125:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:2.0:1783141965.962128:0:15439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141965.962134:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899ba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0277 expref: 9 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.962151:0:15439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bbd7b600, rc 0) 00000100:00100000:2.0:1783141965.962240:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+8:14369:x1869759492767744:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 756us (1878us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1783141965.962248:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 23 00000100:00100000:3.0:1783141965.964855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141965.965376:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492768000 00000100:00100000:0.0:1783141965.965391:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492768000 00000100:00100000:0.0:1783141965.965522:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 24 00000100:00100000:0.0:1783141965.965796:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baaca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+8:14369:x1869759492768000:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:0.0:1783141965.965895:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783141965.965931:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899ba2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0270 expref: 8 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.965955:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94648a1ad500) 00010000:00010000:0.0:1783141965.965971:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783141965.966002:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.966017:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.966028:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783141965.966324:0:14124:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009db815fa reply state 000000009feb1d62 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141965.966336:0:14124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783141965.966352:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1783141965.966759:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baaca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+9:14369:x1869759492768000:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 1224us (1914us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783141965.966769:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 24 00010000:00010000:0.0:1783141965.969729:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.969753:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.969761:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.969786:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141965.969791:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.969801:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.969821:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94648a1ad200) 00010000:00010000:0.0:1783141965.969824:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1783141965.969830:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141965.969837:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899bb7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141965.971043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141965.971149:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492768256 00000100:00100000:1.0:1783141965.971161:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492768256 00000100:00100000:1.0:1783141965.971227:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:1.0:1783141965.971240:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+8:14369:x1869759492768256:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1783141965.971624:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+9:14369:x1869759492768256:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 386us (592us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783141965.971633:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:1.0:1783141965.974724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141965.974823:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492768512 00000100:00100000:3.0:1783141965.974836:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492768512 00000100:00100000:3.0:1783141965.974905:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:3.0:1783141965.974918:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+9:14369:x1869759492768512:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1783141965.974949:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141965.974974:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a027e expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975069:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975087:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975102:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975139:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975148:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975155:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141965.975340:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783141965.975453:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975836:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975845:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975852:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141965.975858:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975867:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975883:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141965.975887:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141965.975892:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975914:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899bc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975932:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975939:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975944:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975949:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141965.975952:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975959:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975967:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff946489eed200) 00010000:00010000:3.0:1783141965.975969:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141965.975972:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.975978:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899bcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.976029:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899bbe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a027e expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.976051:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:3.0:1783141965.976054:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141965.976058:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a027e expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141965.976067:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16c00, rc 0) 00000100:00100000:3.0:1783141965.976151:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+10:14369:x1869759492768512:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1235us (1440us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1783141965.976160:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 25 00000100:00100000:3.0:1783141965.981831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141965.982025:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492768640 00000100:00100000:2.0:1783141965.982037:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492768640 00000100:00100000:2.0:1783141965.982108:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:2.0:1783141965.982118:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+10:14369:x1869759492768640:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141965.982148:0:15439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141965.982175:0:15439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899bda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0285 expref: -99 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.982301:0:15439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.982318:0:15439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.982330:0:15439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141965.982392:0:15439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783141965.982395:0:15439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783141965.982418:0:15439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.982444:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899bda lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0285 expref: 12 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.982819:0:15439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0285 expref: 11 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141965.982831:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464a18ebb00) 00010000:00010000:2.0:1783141965.982834:0:15439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783141965.982838:0:15439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bbd7a400, rc 0) 00000100:00100000:2.0:1783141965.982992:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:caf0c8a4-b162-4255-923a-5fdfd2959d97+11:14369:x1869759492768640:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 873us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141965.983001:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 26 00000100:00100000:1.0:1783141965.986916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141965.987030:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492768768 00000100:00100000:3.0:1783141965.987044:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492768768 00000100:00100000:3.0:1783141965.987153:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:3.0:1783141965.987165:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+11:14369:x1869759492768768:12345-192.168.203.27@tcp:37:lfs.0 00000100:00100000:1.0:1783141965.992761:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+11:14369:x1869759492768768:12345-192.168.203.27@tcp:37:lfs.0 Request processed in 5580us (5843us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141965.992778:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:3.0:1783141965.996738:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141965.996828:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492769024 00000100:00100000:0.0:1783141965.996840:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492769024 00000100:00100000:0.0:1783141965.996908:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:0.0:1783141965.996921:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649e7c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+11:14369:x1869759492769024:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:0.0:1783141965.997255:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649e7c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+12:14369:x1869759492769024:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 334us (529us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783141965.997264:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:3.0:1783141966.038764:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141966.038974:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492769152 00000100:00100000:0.0:1783141966.038989:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492769152 00000100:00100000:0.0:1783141966.039067:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 27 00000100:00100000:0.0:1783141966.039080:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+10:14375:x1869759492769152:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:0.0:1783141966.039109:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141966.039151:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899be8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a028c expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039236:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039253:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039266:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039283:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039290:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039297:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039435:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899bfd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039445:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899bfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039452:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899bfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141966.039551:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783141966.039556:0:14123:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783141966.039614:0:14123:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899bfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039638:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039645:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039664:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039671:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141966.039675:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039684:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039698:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:0.0:1783141966.039702:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141966.039707:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039715:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6e00/0x279ffa91da899bef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039732:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039738:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039743:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039755:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7e00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141966.039758:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039764:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039773:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94648a1ad200) 00010000:00010000:0.0:1783141966.039776:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141966.039779:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039785:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7e00/0x279ffa91da899bf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039820:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899be8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a028c expref: 12 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039833:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6200/0x279ffa91da899bfd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a028c expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.039841:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464a18ebb00) 00010000:00010000:0.0:1783141966.039843:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783141966.039846:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6200, rc 0) 00000100:00100000:0.0:1783141966.039922:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+11:14375:x1869759492769152:12345-192.168.203.27@tcp:101:bash.0 Request processed in 844us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141966.039930:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 27 00000040:00080000:3.0:1783141966.043257:0:14155:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783141966.045167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141966.045258:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492769408 00000100:00100000:1.0:1783141966.045271:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492769408 00000100:00100000:1.0:1783141966.045348:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 28 00000100:00100000:1.0:1783141966.045360:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+11:14375:x1869759492769408:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:1.0:1783141966.045387:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141966.045413:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899c04 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a0293 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.045612:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.045629:0:14125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0285 expref: 11 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.045669:0:14125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.045715:0:14125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0285 expref: 11 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.045730:0:14125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0285 expref: 11 pid: 15439 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141966.045746:0:14125:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14125:1869759510580992:192.168.203.27@tcp:104: 00000100:00100000:1.0:1783141966.045870:0:14125:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489e42480 going to sleep for 11 seconds 00000100:00100000:3.0:1783141966.048815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141966.048918:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492769536 00000100:00100000:2.0:1783141966.048930:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492769536 00010000:00010000:2.0:1783141966.049003:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0285 expref: 12 pid: 15439 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141966.049051:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:2.0:1783141966.049063:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+12:2368:x1869759492769536:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141966.049082:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141966.049090:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0285 expref: 12 pid: 15439 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.049104:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0285 expref: 12 pid: 15439 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.049130:0:14108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464a18ebb00) 00010000:00010000:2.0:1783141966.049136:0:14108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.049149:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.049157:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.049180:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141966.049250:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caf0c8a4-b162-4255-923a-5fdfd2959d97+12:2368:x1869759492769536:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 189us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141966.049259:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00010000:00010000:1.0:1783141966.049785:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a400/0x279ffa91da899be1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0285 expref: 11 pid: 15439 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141966.049808:0:14125:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485000700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14125:1869759510580992:192.168.203.27@tcp:104: 00010000:00010000:1.0:1783141966.049835:0:14125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.049846:0:14125:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.049854:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.049882:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.049893:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.050007:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.055841:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.055867:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.055881:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141966.055897:0:14125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783141966.055937:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.055945:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.055952:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.055959:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141966.055964:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.055972:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.055986:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464a18ebb00) 00010000:00010000:1.0:1783141966.055990:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141966.056010:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.056017:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899c0b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783141966.056035:0:14125:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065f8e3c3 reply state 00000000064236ae transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141966.056044:0:14125:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783141966.056093:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899c04 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0293 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.056108:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0293 expref: 13 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.056116:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:1.0:1783141966.056118:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783141966.056121:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2175600, rc 0) 00000100:00100000:1.0:1783141966.056435:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464baacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+14:14375:x1869759492769408:12345-192.168.203.27@tcp:101:bash.0 Request processed in 11074us (11278us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783141966.056446:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 28 00010000:00010000:0.0:1783141966.069756:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.069798:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.069807:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.069814:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141966.069820:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.069829:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.069848:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9464852b8900) 00010000:00010000:0.0:1783141966.069852:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141966.069857:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.069863:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899c12 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141966.081991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141966.082093:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492769664 00000100:00100000:3.0:1783141966.082105:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492769664 00000100:00100000:3.0:1783141966.082174:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:3.0:1783141966.082185:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+13:14375:x1869759492769664:12345-192.168.203.27@tcp:101:bash.0 00010000:00010000:3.0:1783141966.082216:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141966.082243:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c27 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a029a expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.082348:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.082366:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.082382:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141966.082432:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783141966.082437:0:14123:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783141966.082526:0:14123:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.082552:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.082591:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c27 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a029a expref: 15 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.082614:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a029a expref: 14 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.082624:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:3.0:1783141966.082628:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141966.082631:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17200, rc 0) 00000100:00100000:3.0:1783141966.082818:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+14:14375:x1869759492769664:12345-192.168.203.27@tcp:101:bash.0 Request processed in 633us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141966.082826:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 29 00000100:00100000:3.0:1783141966.090599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141966.091394:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492769920 00000100:00100000:0.0:1783141966.091410:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492769920 00000100:00100000:0.0:1783141966.091529:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:0.0:1783141966.091552:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+14:14375:x1869759492769920:12345-192.168.203.27@tcp:35:bash.0 00000100:00100000:0.0:1783141966.091992:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+15:14375:x1869759492769920:12345-192.168.203.27@tcp:35:bash.0 Request processed in 441us (1415us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1783141966.092000:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:1.0:1783141966.165496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141966.165602:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492770176 00000100:00100000:2.0:1783141966.165619:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492770176 00000100:00100000:2.0:1783141966.165695:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:2.0:1783141966.165725:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+15:14385:x1869759492770176:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141966.165758:0:15439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141966.165784:0:15439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899c35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02a1 expref: -99 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141966.165951:0:15439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783141966.166102:0:15439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899c35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02a1 expref: 17 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.166120:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94648a1ade00) 00010000:00010000:2.0:1783141966.166123:0:15439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783141966.166130:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02a1 expref: 17 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.166148:0:15439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bbd7b600, rc 0) 00000100:00100000:2.0:1783141966.166229:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+16:14385:x1869759492770176:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 507us (781us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1783141966.166239:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 30 00000100:00100000:0.0:1783141966.171561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141966.172005:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492770432 00000100:00100000:1.0:1783141966.172019:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492770432 00000100:00100000:1.0:1783141966.172133:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:1.0:1783141966.172146:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+16:14385:x1869759492770432:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:1.0:1783141966.172545:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+17:14385:x1869759492770432:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 400us (1001us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783141966.172575:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:3.0:1783141966.224844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141966.224995:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492770688 00000100:00100000:2.0:1783141966.225008:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492770688 00000100:00100000:2.0:1783141966.225085:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:2.0:1783141966.225098:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+17:14388:x1869759492770688:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1783141966.225130:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141966.225156:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899c43 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02a8 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.225287:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899c4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.225322:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899c4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.225337:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899c4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783141966.225352:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783141966.225558:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899c43 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02a8 expref: 20 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.225591:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899c4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02a8 expref: 19 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.225602:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:2.0:1783141966.225606:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783141966.225610:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bbd7a600, rc 0) 00000100:00100000:2.0:1783141966.225804:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+19:14388:x1869759492770688:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 708us (976us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783141966.225813:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 31 00000100:00100000:0.0:1783141966.229242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141966.229289:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141966.229832:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492770816 00000100:00100000:2.0:1783141966.229845:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492770816 00000100:00100000:2.0:1783141966.229926:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:2.0:1783141966.229938:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+19:2366:x1869759492770816:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141966.229957:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141966.229989:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899c4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02a8 expref: 19 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.230036:0:14109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:2.0:1783141966.230042:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783141966.230117:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+18:2366:x1869759492770816:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 181us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141966.230126:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:3.0:1783141966.230923:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492770944 00000100:00100000:3.0:1783141966.230933:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492770944 00000100:00100000:3.0:1783141966.231406:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:3.0:1783141966.231420:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+18:14388:x1869759492770944:12345-192.168.203.27@tcp:54:lfs.0 00010000:00010000:3.0:1783141966.231556:0:15439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.231588:0:15439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.231602:0:15439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.231638:0:15439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.231645:0:15439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.231652:0:15439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.231660:0:15439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe16c00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141966.231680:0:15439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.231689:0:15439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.231702:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:3.0:1783141966.231723:0:15439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783141966.231730:0:15439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.231738:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141966.231823:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+18:14388:x1869759492770944:12345-192.168.203.27@tcp:54:lfs.0 Request processed in 406us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141966.231832:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 32 00000100:00100000:0.0:1783141966.240021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141966.240179:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492771200 00000100:00100000:3.0:1783141966.240190:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492771200 00000100:00100000:3.0:1783141966.240261:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1783141966.240273:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:336df830-3a74-41f7-9e23-8cb53be5699f+18:14388:x1869759492771200:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1783141966.240863:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:336df830-3a74-41f7-9e23-8cb53be5699f+19:14388:x1869759492771200:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 590us (855us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1783141966.240874:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:1.0:1783141966.491129:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141966.491344:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492771456 00000100:00100000:3.0:1783141966.491358:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492771456 00000100:00100000:3.0:1783141966.491435:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:3.0:1783141966.491448:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+19:14419:x1869759492771456:12345-192.168.203.27@tcp:101:cat.0 00010000:00010000:3.0:1783141966.491587:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141966.491625:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02af expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.491863:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899c66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.491881:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899c66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.491910:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899c66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141966.491925:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783141966.492104:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02af expref: 22 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.492127:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899c66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02af expref: 21 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.492137:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:3.0:1783141966.492141:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783141966.492145:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe17600, rc 0) 00000100:00100000:3.0:1783141966.492353:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+21:14419:x1869759492771456:12345-192.168.203.27@tcp:101:cat.0 Request processed in 906us (1238us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1783141966.492362:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 33 00000100:00100000:2.0:1783141966.497228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141966.497342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141966.497423:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492771840 00000100:00100000:3.0:1783141966.497436:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492771840 00000100:00100000:3.0:1783141966.497639:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:3.0:1783141966.497767:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:336df830-3a74-41f7-9e23-8cb53be5699f+21:2368:x1869759492771840:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141966.497791:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141966.497828:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899c66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02af expref: 21 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.497851:0:14110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:3.0:1783141966.497856:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141966.497953:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:336df830-3a74-41f7-9e23-8cb53be5699f+20:2368:x1869759492771840:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 303us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141966.497961:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:1.0:1783141966.498978:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492771712 00000100:00100000:1.0:1783141966.498988:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492771712 00000100:00100000:1.0:1783141966.499038:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:1.0:1783141966.499048:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+20:14419:x1869759492771712:12345-192.168.203.27@tcp:35:cat.0 00000100:00100000:1.0:1783141966.499452:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+21:14419:x1869759492771712:12345-192.168.203.27@tcp:35:cat.0 Request processed in 404us (2236us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1783141966.499545:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 8 00000100:00100000:2.0:1783141966.563509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141966.563678:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492772096 00000100:00100000:3.0:1783141966.563691:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492772096 00000100:00100000:3.0:1783141966.563771:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:3.0:1783141966.563784:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+21:14425:x1869759492772096:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:3.0:1783141966.563818:0:15439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783141966.563843:0:15439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899c74 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02b6 expref: -99 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.563965:0:15439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.563982:0:15439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0293 expref: 22 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.563990:0:15439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a029a expref: 22 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.563998:0:15439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.564038:0:15439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a029a expref: 22 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.564052:0:15439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a029a expref: 22 pid: 14123 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141966.564091:0:15439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba668e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15439:1869759510581120:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141966.564226:0:15439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0293 expref: 22 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.564245:0:15439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0293 expref: 22 pid: 14125 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141966.564255:0:15439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15439:1869759510581248:192.168.203.27@tcp:104: 00000100:00100000:3.0:1783141966.564279:0:15439:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489df8480 going to sleep for 11 seconds 00000100:00100000:0.0:1783141966.577056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141966.577098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141966.577192:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492772224 00000100:00100000:1.0:1783141966.577203:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492772224 00010000:00010000:1.0:1783141966.577253:0:14109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a029a expref: 23 pid: 14123 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141966.577293:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492772352 00000100:00100000:1.0:1783141966.577296:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492772352 00010000:00010000:1.0:1783141966.577308:0:14109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0293 expref: 24 pid: 14125 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141966.577322:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:1.0:1783141966.577332:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464bfe33450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+24:2369:x1869759492772224:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141966.577348:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141966.577355:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a029a expref: 24 pid: 14123 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.577369:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a029a expref: 24 pid: 14123 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.577421:0:14109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:1.0:1783141966.577427:0:14109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.577437:0:14109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.577444:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141966.577536:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464bfe33450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+24:2369:x1869759492772224:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 204us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141966.577545:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:1.0:1783141966.577608:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 12 00000100:00100000:1.0:1783141966.577616:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+23:2369:x1869759492772352:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141966.577624:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141966.577628:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0293 expref: 23 pid: 14125 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.577638:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0293 expref: 23 pid: 14125 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.577649:0:14109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:1.0:1783141966.577652:0:14109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.577660:0:14109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.577679:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.577700:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141966.577722:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+23:2369:x1869759492772352:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 107us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141966.577728:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 12 00010000:00010000:3.0:1783141966.577916:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899c2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a029a expref: 22 pid: 14123 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141966.577935:0:15439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba668e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15439:1869759510581120:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141966.577948:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899c19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a0293 expref: 21 pid: 14125 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141966.577958:0:15439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15439:1869759510581248:192.168.203.27@tcp:104: 00010000:00010000:3.0:1783141966.577981:0:15439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.577991:0:15439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.577997:0:15439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783141966.578031:0:15439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783141966.578231:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899c74 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02b6 expref: 22 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.578248:0:15439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe16c00/0x279ffa91da899c7b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02b6 expref: 21 pid: 15439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141966.578256:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:3.0:1783141966.578258:0:15439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783141966.578261:0:15439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bfe16c00, rc 0) 00000100:00100000:3.0:1783141966.578294:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+21:14425:x1869759492772096:12345-192.168.203.27@tcp:101:dd.0 Request processed in 14513us (14845us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1783141966.578301:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 34 00000100:00100000:1.0:1783141966.595011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141966.595086:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492772608 00000100:00100000:2.0:1783141966.595100:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492772608 00000100:00100000:2.0:1783141966.595176:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 35 00000100:00100000:2.0:1783141966.595188:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+21:14425:x1869759492772608:12345-192.168.203.27@tcp:36:dd.0 00010000:00010000:2.0:1783141966.595561:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.595590:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.595605:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141966.595664:0:14124:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1783141966.595703:0:14124:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dfe250d8 reply state 00000000fa95a67f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141966.595714:0:14124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141966.595832:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+24:14425:x1869759492772608:12345-192.168.203.27@tcp:36:dd.0 Request processed in 644us (835us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1783141966.595860:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 35 00000020:00080000:2.0:1783141966.595866:0:14124:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783141966.604228:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.604250:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.604258:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.604263:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141966.604269:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.604277:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.604298:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:0.0:1783141966.604302:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141966.604308:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.604315:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899c89 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141966.608658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141966.608709:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492772736 00000100:00100000:0.0:1783141966.608723:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492772736 00000100:00100000:0.0:1783141966.608818:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:0.0:1783141966.608831:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+23:14425:x1869759492772736:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:0.0:1783141966.608864:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141966.608896:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899c90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02bd expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.608971:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899c90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02bd expref: 24 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.608989:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899c90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02bd expref: 24 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.609013:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:0.0:1783141966.609017:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141966.609020:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7a00, rc 0) 00000100:00100000:0.0:1783141966.609098:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+24:14425:x1869759492772736:12345-192.168.203.27@tcp:101:dd.0 Request processed in 269us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141966.609105:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 36 00000100:00100000:2.0:1783141966.633837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141966.633954:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492772992 00000100:00100000:1.0:1783141966.633966:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492772992 00000100:00100000:1.0:1783141966.634041:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:1.0:1783141966.634053:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+24:14425:x1869759492772992:12345-192.168.203.27@tcp:103:dd.0 00010000:00010000:1.0:1783141966.634075:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141966.634108:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7a00/0x279ffa91da899c90 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02bd expref: 24 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141966.634132:0:14109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:1.0:1783141966.634137:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783141966.634297:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+23:14425:x1869759492772992:12345-192.168.203.27@tcp:103:dd.0 Request processed in 244us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141966.634306:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:1.0:1783141966.640276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141966.640417:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492773120 00000100:00100000:2.0:1783141966.640430:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492773120 00000100:00100000:2.0:1783141966.640542:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:2.0:1783141966.640554:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+23:14425:x1869759492773120:12345-192.168.203.27@tcp:58:dd.0 00010000:00010000:2.0:1783141966.640688:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.640707:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141966.640726:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141966.641652:0:14124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783141966.641813:0:14124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1783141966.641895:0:14124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1783141966.642039:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+23:14425:x1869759492773120:12345-192.168.203.27@tcp:58:dd.0 Request processed in 1480us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141966.642051:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 37 00000100:00100000:2.0:1783141966.648293:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141966.648798:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492773248 00000100:00100000:0.0:1783141966.648814:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492773248 00000100:00100000:0.0:1783141966.648903:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 38 00000100:00100000:0.0:1783141966.648916:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+23:14425:x1869759492773248:12345-192.168.203.27@tcp:101:dd.0 00010000:00010000:0.0:1783141966.648945:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141966.648972:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899c9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02c4 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.649051:0:14125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.649081:0:14125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899c9e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02c4 expref: 24 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.649108:0:14125:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.649124:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899c9e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02c4 expref: 24 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.649140:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:0.0:1783141966.649144:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783141966.649149:0:14125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899c9e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02c4 expref: 24 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141966.649157:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7000, rc 0) 00000100:00100000:0.0:1783141966.649245:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+24:14425:x1869759492773248:12345-192.168.203.27@tcp:101:dd.0 Request processed in 332us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141966.649253:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 38 00010000:00010000:1.0:1783141966.749314:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783141967.067088:0:14155:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783141967.067101:0:14155:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783141967.067149:0:14155:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783141967.067157:0:14155:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783141967.067314:0:14155:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464ba668a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14155:1869759510581376:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783141967.067510:0:14155:0:(client.c:2701:ptlrpc_set_wait()) set ffff946489df8540 going to sleep for 11 seconds 00000100:00100000:3.0:1783141967.071366:0:14155:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464ba668a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14155:1869759510581376:192.168.203.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783141967.079809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141967.081086:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492773376 00000100:00100000:3.0:1783141967.081161:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492773376 00000100:00100000:3.0:1783141967.081307:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:3.0:1783141967.081320:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:336df830-3a74-41f7-9e23-8cb53be5699f+24:14426:x1869759492773376:12345-192.168.203.27@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783141967.081442:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:336df830-3a74-41f7-9e23-8cb53be5699f+24:14426:x1869759492773376:12345-192.168.203.27@tcp:900:lhsmtool_posix.0 Request processed in 126us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141967.081499:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00080000:1.0:1783141967.083248:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783141967.093872:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141967.098613:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492773504 00000100:00100000:0.0:1783141967.098636:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492773504 00000100:00100000:0.0:1783141967.098883:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:0.0:1783141967.098896:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+24:14426:x1869759492773504:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783141967.098941:0:14123:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783141967.099095:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+24:14426:x1869759492773504:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 201us (5238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141967.099103:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 39 00000100:00100000:3.0:1783141967.103412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141967.104137:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492773632 00000100:00100000:1.0:1783141967.104169:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492773632 00000100:00100000:1.0:1783141967.104242:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:1.0:1783141967.104254:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+24:14426:x1869759492773632:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783141967.104352:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104374:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104390:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104406:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104414:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104420:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104447:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104457:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104517:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141967.104582:0:14125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783141967.104586:0:14125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141967.104615:0:14125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104628:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104634:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104642:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104661:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141967.104666:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104675:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104690:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648a1ad100) 00010000:00010000:1.0:1783141967.104693:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141967.104699:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104705:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899ca5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104719:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104725:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104730:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104741:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141967.104744:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104750:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104758:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9464852b8700) 00010000:00010000:1.0:1783141967.104761:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141967.104764:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104769:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899cac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104786:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104793:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104798:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104804:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464c2174200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:1.0:1783141967.104808:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104813:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104832:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:1.0:1783141967.104834:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783141967.104837:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.104843:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141967.104932:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+24:14426:x1869759492773632:12345-192.168.203.27@tcp:34:lhsmtool_posix.0 Request processed in 679us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141967.104942:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 40 00000100:00100000:1.0:1783141967.108797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141967.108916:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492773888 00000100:00100000:0.0:1783141967.108930:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492773888 00000100:00100000:0.0:1783141967.109014:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:0.0:1783141967.109026:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+24:14426:x1869759492773888:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141967.109056:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141967.109082:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899cba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02cb expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109215:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109234:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109248:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783141967.109262:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783141967.109708:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109719:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109727:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109734:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6000 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141967.109738:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109747:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109785:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:0.0:1783141967.109789:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783141967.109795:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109802:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d6000/0x279ffa91da899cc1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109857:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899cba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02cb expref: 26 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109868:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94648a1ad100) 00010000:00010000:0.0:1783141967.109870:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783141967.109874:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7200/0x279ffa91da899cba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02cb expref: 26 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.109886:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d7200, rc 0) 00000100:00100000:0.0:1783141967.109973:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+25:14426:x1869759492773888:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 948us (1188us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1783141967.109982:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 41 00000100:00100000:2.0:1783141967.120264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141967.120525:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492774016 00000100:00100000:3.0:1783141967.120550:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492774016 00000100:00100000:3.0:1783141967.120632:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:3.0:1783141967.120644:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+25:14426:x1869759492774016:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783141967.120694:0:15439:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783141967.120829:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+25:14426:x1869759492774016:12345-192.168.203.27@tcp:53:lhsmtool_posix.0 Request processed in 186us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141967.120837:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:3.0:1783141967.124678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141967.124901:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492774272 00000100:00100000:1.0:1783141967.124914:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492774272 00000100:00100000:1.0:1783141967.124990:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:1.0:1783141967.125002:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+25:14426:x1869759492774272:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141967.125031:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141967.125055:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899ccf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02d2 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783141967.125936:0:14125:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1783141967.125947:0:14125:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1783141967.126013:0:14125:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1783141967.126346:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899cd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.126366:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.126392:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.126511:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174600/0x279ffa91da899ccf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02d2 expref: 28 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.126535:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02d2 expref: 27 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.126545:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8700) 00010000:00010000:1.0:1783141967.126549:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783141967.126553:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174000, rc 0) 00000100:00100000:1.0:1783141967.126646:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+27:14426:x1869759492774272:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 1645us (1982us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1783141967.126656:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:1.0:1783141967.130808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141967.130908:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492774528 00000100:00100000:3.0:1783141967.130921:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492774528 00000100:00100000:3.0:1783141967.130993:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:3.0:1783141967.131006:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+27:14426:x1869759492774528:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783141967.131084:0:15439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141967.131116:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174000/0x279ffa91da899cd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02d2 expref: 27 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131139:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8700) 00010000:00010000:3.0:1783141967.131153:0:15439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783141967.131179:0:15439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131195:0:15439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131231:0:15439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131250:0:15439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131258:0:15439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131265:0:15439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131360:0:15439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131368:0:15439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131376:0:15439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131382:0:15439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141967.131387:0:15439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131395:0:15439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131405:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9464a18ebb00) 00010000:00010000:3.0:1783141967.131408:0:15439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141967.131413:0:15439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131430:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17600/0x279ffa91da899ce4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131441:0:15439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131448:0:15439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131454:0:15439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131506:0:15439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:3.0:1783141967.131509:0:15439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131518:0:15439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131526:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x402c18c2 (ffff946489eed200) 00010000:00010000:3.0:1783141967.131529:0:15439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783141967.131542:0:15439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.131549:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bfe17200/0x279ffa91da899ceb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x402c18c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141967.132181:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+26:14426:x1869759492774528:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 1172us (1382us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783141967.132192:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:2.0:1783141967.134882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141967.135082:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492774656 00000100:00100000:1.0:1783141967.135095:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492774656 00000100:00100000:1.0:1783141967.135154:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:1.0:1783141967.135166:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+26:14426:x1869759492774656:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141967.135194:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141967.135223:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899cf2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02d9 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.135268:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cf9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.135305:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.135319:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.135439:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2175600/0x279ffa91da899cf2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02d9 expref: 28 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.135809:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464c2174200/0x279ffa91da899cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02d9 expref: 27 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.135821:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8a00) 00010000:00010000:1.0:1783141967.135824:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783141967.135828:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464c2174200, rc 0) 00000100:00100000:1.0:1783141967.135912:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+27:14426:x1869759492774656:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 749us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141967.135921:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:1.0:1783141967.139302:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.139382:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492774912 00000100:00100000:2.0:1783141967.139396:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492774912 00000100:00100000:2.0:1783141967.139510:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:2.0:1783141967.139555:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+27:14426:x1869759492774912:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783141967.139674:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.139693:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.139708:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783141967.140209:0:14124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1783141967.140222:0:14124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 474344761281ns, next at 475344758466ns, rc = 0 00000004:00010000:2.0:1783141967.140329:0:14124:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009104d030 reply state 000000002fc9df41 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.140340:0:14124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141967.140497:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+29:14426:x1869759492774912:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 944us (1207us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1783141967.140507:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:1.0:1783141967.145551:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.145848:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492775040 00000100:00100000:2.0:1783141967.145861:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492775040 00000100:00100000:2.0:1783141967.145937:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 47 00000100:00100000:2.0:1783141967.145949:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+29:14426:x1869759492775040:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141967.145982:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141967.146009:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02e0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.146092:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e0 expref: 30 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.146134:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e0 expref: 30 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.146161:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8a00) 00010000:00010000:2.0:1783141967.146164:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141967.146169:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bbd7a800, rc 0) 00000100:00100000:2.0:1783141967.146280:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+30:14426:x1869759492775040:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 333us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.146289:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 47 00010000:00010000:0.0:1783141967.146782:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.146794:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.146802:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.146821:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7aa00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141967.146826:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.146835:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.146848:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8a00) 00010000:00010000:0.0:1783141967.146851:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783141967.146855:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.146861:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7aa00/0x279ffa91da899d00 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.149751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141967.149839:0:14759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492775168 00000100:00100000:0.0:1783141967.149850:0:14759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492775168 00000100:00100000:0.0:1783141967.149993:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:0.0:1783141967.150007:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:336df830-3a74-41f7-9e23-8cb53be5699f+5:2368:x1869759492775168:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783141967.150535:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:336df830-3a74-41f7-9e23-8cb53be5699f+6:2368:x1869759492775168:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 529us (794us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783141967.150544:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00080000:1.0:1783141967.150673:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141967.154071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141967.154155:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492775424 00000100:00100000:0.0:1783141967.154169:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492775424 00000100:00100000:0.0:1783141967.154239:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:0.0:1783141967.154251:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+29:14426:x1869759492775424:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783141967.154600:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+30:14426:x1869759492775424:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 349us (541us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1783141967.154626:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:3.0:1783141967.157001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.157191:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492775680 00000100:00100000:2.0:1783141967.157204:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492775680 00000100:00100000:2.0:1783141967.157270:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:2.0:1783141967.157282:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+30:14426:x1869759492775680:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783141967.157424:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+30:14426:x1869759492775680:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 143us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.157432:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 48 00000100:00100000:2.0:1783141967.160135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141967.160243:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492775808 00000100:00100000:1.0:1783141967.160255:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492775808 00000100:00100000:1.0:1783141967.160323:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:1.0:1783141967.160335:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+30:14426:x1869759492775808:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783141967.160360:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783141967.160401:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899d0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02e7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.160630:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52800/0x279ffa91da899d15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.160658:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52800/0x279ffa91da899d15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.160672:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52800/0x279ffa91da899d15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783141967.160721:0:14125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783141967.160743:0:14125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52800/0x279ffa91da899d15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.160774:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52200/0x279ffa91da899d0e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e7 expref: 32 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.160797:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52800/0x279ffa91da899d15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e7 expref: 31 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.160806:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8a00) 00010000:00010000:1.0:1783141967.160810:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783141967.160814:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946496f52800, rc 0) 00000100:00100000:1.0:1783141967.160889:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+31:14426:x1869759492775808:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 555us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141967.160897:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 49 00000100:00100000:1.0:1783141967.164201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.164302:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492775936 00000100:00100000:2.0:1783141967.164316:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492775936 00000100:00100000:2.0:1783141967.164384:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:2.0:1783141967.164396:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:336df830-3a74-41f7-9e23-8cb53be5699f+6:2368:x1869759492775936:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783141967.164421:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783141967.164447:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02ee expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783141967.164796:0:14761:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a48964e, blocks: 0x1 00010000:00010000:2.0:1783141967.164822:0:14761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1783141967.164827:0:14761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.164839:0:14761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02ee expref: 7 pid: 14761 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.164862:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02ee expref: 7 pid: 14761 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.164878:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9464bbd7bc00, rc 0) 00000100:00100000:2.0:1783141967.164958:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:336df830-3a74-41f7-9e23-8cb53be5699f+7:2368:x1869759492775936:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 563us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.164966:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:0.0:1783141967.168299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.168402:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492776192 00000100:00100000:2.0:1783141967.168414:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492776192 00000100:00100000:2.0:1783141967.168534:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:2.0:1783141967.168547:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+31:14426:x1869759492776192:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783141967.168855:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:336df830-3a74-41f7-9e23-8cb53be5699f+31:14426:x1869759492776192:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 309us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.168864:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 50 00000100:00100000:1.0:1783141967.171204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.171420:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492776320 00000100:00100000:2.0:1783141967.171434:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492776320 00000100:00100000:2.0:1783141967.171547:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:2.0:1783141967.171559:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+31:14426:x1869759492776320:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783141967.205413:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1783141967.205440:0:5809:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1783141967.205513:0:5809:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1783141967.205894:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510581504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783141967.205986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141967.206259:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:336df830-3a74-41f7-9e23-8cb53be5699f+14:14426:x1869759492776320:12345-192.168.203.27@tcp:44:lhsmtool_posix.0 Request processed in 34697us (35063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.206272:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 51 00000100:00100000:0.0:1783141967.206358:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510581504 00000100:00100000:0.0:1783141967.206367:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510581504 00000100:00100000:0.0:1783141967.206432:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783141967.206441:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1869759510581504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783141967.206788:0:14760:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783141967.206793:0:14760:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1783141967.206795:0:14760:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783141967.206798:0:14760:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783141966 -> 1783141966 00002000:00010000:0.0:1783141967.206800:0:14760:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783141967.206846:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1869759510581504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 406us (859us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1783141967.206853:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1783141967.207081:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946497264700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1783141967.207089:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1869759510581504:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1783141967.208295:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783141967.209491:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.209565:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492776448 00000100:00100000:2.0:1783141967.209588:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492776448 00000100:00100000:2.0:1783141967.209653:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1783141967.209673:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:336df830-3a74-41f7-9e23-8cb53be5699f+7:2368:x1869759492776448:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783141967.209819:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:336df830-3a74-41f7-9e23-8cb53be5699f+7:2368:x1869759492776448:12345-192.168.203.27@tcp:16:lhsmtool_posix.0 Request processed in 155us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.209826:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:3.0:1783141967.213608:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.213731:0:15439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492776704 00000100:00100000:2.0:1783141967.213744:0:15439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492776704 00000100:00100000:2.0:1783141967.213824:0:15439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:2.0:1783141967.213836:0:15439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+14:14426:x1869759492776704:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783141967.213906:0:15439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141967.213942:0:15439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946496f52800/0x279ffa91da899d15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e7 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.213963:0:15439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8a00) 00010000:00010000:2.0:1783141967.213967:0:15439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141967.214000:0:15439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.214012:0:15439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.214039:0:15439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783141967.214557:0:15439:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005397098 reply state 0000000037076b01 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.214578:0:15439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783141967.214712:0:15439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:336df830-3a74-41f7-9e23-8cb53be5699f+15:14426:x1869759492776704:12345-192.168.203.27@tcp:36:lhsmtool_posix.0 Request processed in 876us (1116us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1783141967.214720:0:15439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00010000:00010000:0.0:1783141967.217820:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.217842:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.217851:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.217858:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:0.0:1783141967.217864:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.217873:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.217913:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8a00) 00010000:00010000:0.0:1783141967.217916:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783141967.217922:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.217929:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a200/0x279ffa91da899d23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141967.218981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.219392:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492776832 00000100:00100000:2.0:1783141967.219405:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492776832 00000100:00100000:0.0:1783141967.219536:0:14759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:0.0:1783141967.219550:0:14759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:336df830-3a74-41f7-9e23-8cb53be5699f+7:14426:x1869759492776832:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783141967.219582:0:14759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783141967.219606:0:14759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xebfeed7a1e9a02f5 expref: -99 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.219653:0:14759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02ee expref: 8 pid: 14761 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.219663:0:14759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141967.219673:0:14759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141967.219678:0:14759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 8 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.219718:0:14759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02ee expref: 8 pid: 14761 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.219754:0:14759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02ee expref: 8 pid: 14761 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141967.219771:0:14759:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946497264e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14759:1869759510581632:192.168.203.27@tcp:104: 00000100:00100000:0.0:1783141967.219876:0:14759:0:(client.c:2701:ptlrpc_set_wait()) set ffff9464ba592cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783141967.224386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141967.224532:0:14759:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946497264e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14759:1869759510581632:192.168.203.27@tcp:104: 00010000:00010000:0.0:1783141967.224586:0:14759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 8 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.224615:0:14759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94649d0d6000, rc 0) 00000100:00100000:0.0:1783141967.225613:0:14759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:336df830-3a74-41f7-9e23-8cb53be5699f+8:14426:x1869759492776832:12345-192.168.203.27@tcp:101:lhsmtool_posix.0 Request processed in 6059us (6634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783141967.225627:0:14759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:2.0:1783141967.226677:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492776960 00000100:00100000:2.0:1783141967.226692:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492776960 00010000:00010000:2.0:1783141967.226747:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02ee expref: 8 pid: 14761 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.226790:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:2.0:1783141967.226800:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:336df830-3a74-41f7-9e23-8cb53be5699f+8:2368:x1869759492776960:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783141967.226818:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783141967.226845:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02ee expref: 8 pid: 14761 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.226861:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02ee expref: 8 pid: 14761 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.226890:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bb2875c/0x279ffa91da899d1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02ee expref: 8 pid: 14761 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.226931:0:14108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.226936:0:14108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.226943:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 7 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.226956:0:14108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 7 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.227008:0:14108:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 7 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.227024:0:14108:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14108:1869759510581760:192.168.203.27@tcp:105: 00000100:00100000:2.0:1783141967.227113:0:14108:0:(client.c:2701:ptlrpc_set_wait()) set ffff946482f34000 going to sleep for 11 seconds 00000100:00100000:2.0:1783141967.230379:0:14108:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14108:1869759510581760:192.168.203.27@tcp:105: 00000100:00100000:3.0:1783141967.230386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00010000:00010000:2.0:1783141967.230412:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783141967.230456:0:15612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492777088 00000100:00100000:0.0:1783141967.230486:0:15612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492777088 00000100:00100000:0.0:1783141967.230549:0:15612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:0.0:1783141967.230560:0:15612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:336df830-3a74-41f7-9e23-8cb53be5699f+8:2369:x1869759492777088:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783141967.230864:0:15612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783141967.230869:0:15612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783141966 00002000:00010000:0.0:1783141967.230872:0:15612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783141965 00002000:00010000:0.0:1783141967.230874:0:15612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783141966 -> 1783141966 00002000:00010000:0.0:1783141967.230877:0:15612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783141967.232759:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:336df830-3a74-41f7-9e23-8cb53be5699f+9:2368:x1869759492776960:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 5946us (8373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.232776:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 13 00000100:00100000:0.0:1783141967.232826:0:15612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:336df830-3a74-41f7-9e23-8cb53be5699f+8:2369:x1869759492777088:12345-192.168.203.27@tcp:2:lhsmtool_posix.0 Request processed in 2266us (2439us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783141967.232856:0:15612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:3.0:1783141967.236151:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.236239:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492777216 00000100:00100000:2.0:1783141967.236252:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492777216 00000100:00100000:2.0:1783141967.236321:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:2.0:1783141967.236333:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:336df830-3a74-41f7-9e23-8cb53be5699f+8:2367:x1869759492777216:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783141967.236394:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.236438:0:14760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 8 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.236447:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.236452:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783141967.240136:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.240225:0:14760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 8 pid: 14759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.240248:0:14760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 8 pid: 14759 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.240268:0:14760:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14760:1869759510581888:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141967.240386:0:14760:0:(client.c:2701:ptlrpc_set_wait()) set ffff946482f34000 going to sleep for 11 seconds 00000100:00100000:1.0:1783141967.244162:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.244347:0:14760:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14760:1869759510581888:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141967.244384:0:14760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141967.244386:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492777344 00000100:00100000:3.0:1783141967.244399:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492777344 00010000:00010000:3.0:1783141967.244448:0:14109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 9 pid: 14759 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141967.244815:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 14 00000100:00100000:3.0:1783141967.244828:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+9:2368:x1869759492777344:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783141967.244847:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783141967.244875:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 9 pid: 14759 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.244891:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 9 pid: 14759 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.244917:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dcee263/0x279ffa91da899d2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02f5 expref: 9 pid: 14759 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.244952:0:14109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141967.244957:0:14109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783141967.244964:0:14109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.244975:0:14109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.245004:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783141967.245067:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:336df830-3a74-41f7-9e23-8cb53be5699f+8:2368:x1869759492777344:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 241us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141967.245075:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 14 00010000:00010000:2.0:1783141967.245144:0:14760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.245157:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.245206:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.245213:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.245222:0:14760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.245230:0:14760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141967.245234:0:14760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.245243:0:14760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.245260:0:14760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.245268:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af87e557/0x279ffa91da899d31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.245348:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:336df830-3a74-41f7-9e23-8cb53be5699f+7:2367:x1869759492777216:12345-192.168.203.27@tcp:1:lhsmtool_posix.0 Request processed in 9014us (9207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.245372:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 16 00000100:00100000:1.0:1783141967.253157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141967.255269:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492777600 00000100:00100000:3.0:1783141967.255288:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492777600 00000100:00100000:2.0:1783141967.255587:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:2.0:1783141967.255602:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+14:14426:x1869759492777600:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783141967.255687:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.255703:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.255714:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.255962:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.255973:0:14123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e0 expref: 15 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.255982:0:14123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.256014:0:14123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e0 expref: 15 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.256028:0:14123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e0 expref: 15 pid: 14125 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.256043:0:14123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869759510582016:192.168.203.27@tcp:104: 00000100:00100000:2.0:1783141967.256149:0:14123:0:(client.c:2701:ptlrpc_set_wait()) set ffff946482f34000 going to sleep for 11 seconds 00000100:00100000:1.0:1783141967.262346:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.262597:0:14123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869759510582016:192.168.203.27@tcp:104: 00010000:00010000:2.0:1783141967.262625:0:14123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141967.262912:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492777728 00000100:00100000:0.0:1783141967.262925:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492777728 00010000:00010000:1.0:1783141967.263048:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e0 expref: 16 pid: 14125 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141967.263088:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 15 00000100:00100000:1.0:1783141967.263097:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464971db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:336df830-3a74-41f7-9e23-8cb53be5699f+16:2368:x1869759492777728:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783141967.263114:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783141967.263121:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e0 expref: 16 pid: 14125 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.263134:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e0 expref: 16 pid: 14125 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.263157:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a800/0x279ffa91da899d07 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02e0 expref: 16 pid: 14125 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.263175:0:14108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8a00) 00010000:00010000:1.0:1783141967.263180:0:14108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.263192:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.263199:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.263242:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783141967.263286:0:14123:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.263299:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141967.263309:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:336df830-3a74-41f7-9e23-8cb53be5699f+15:2368:x1869759492777728:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 210us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141967.263319:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 15 00000001:00080000:2.0:1783141967.263628:0:14123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1783141967.263818:0:14123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1783141967.263991:0:14123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1783141967.264092:0:14123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14123:1869759510582144:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783141967.264189:0:14123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783141967.264223:0:14123:0:(client.c:2701:ptlrpc_set_wait()) set ffff94648761af00 going to sleep for 11 seconds 00000100:00100000:3.0:1783141967.264254:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510582144 00000100:00100000:3.0:1783141967.264261:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510582144 00000100:00100000:3.0:1783141967.264306:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783141967.264316:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14123:x1869759510582144:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783141967.264625:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14123:x1869759510582144:12345-0@lo:1000:mdt00_000.0 Request processed in 310us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783141967.264634:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783141967.264794:0:14123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485193480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14123:1869759510582144:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1783141967.267182:0:14123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1783141967.267317:0:14123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9464971db100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14123:1869759510582272:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783141967.267552:0:14123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783141967.267604:0:14123:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a480 going to sleep for 11 seconds 00000100:00100000:3.0:1783141967.267628:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759510582272 00000100:00100000:3.0:1783141967.267639:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759510582272 00000100:00100000:3.0:1783141967.267709:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783141967.267724:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14123:x1869759510582272:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783141967.267963:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14123:x1869759510582272:12345-0@lo:1000:mdt00_000.0 Request processed in 243us (545us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783141967.267981:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783141967.268097:0:14123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9464971db100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14123:1869759510582272:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783141967.268142:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268153:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268160:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268167:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7bc00 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141967.268172:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268189:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268207:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8a00) 00010000:00010000:2.0:1783141967.268210:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141967.268216:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268222:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7bc00/0x279ffa91da899d3f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268257:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268262:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268267:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268271:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b200 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141967.268273:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268277:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268283:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:2.0:1783141967.268285:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783141967.268307:0:14123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899c9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02c4 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268329:0:14123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899c9e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02c4 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268339:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899c9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02c4 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.268394:0:14123:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94649d0d7000/0x279ffa91da899c9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.27@tcp remote: 0xebfeed7a1e9a02c4 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.268407:0:14123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff946485190a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869759510582400:192.168.203.27@tcp:105: 00000100:00100000:2.0:1783141967.268553:0:14123:0:(client.c:2701:ptlrpc_set_wait()) set ffff94649739a480 going to sleep for 11 seconds 00000100:00100000:1.0:1783141967.272870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.272929:0:14123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff946485190a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869759510582400:192.168.203.27@tcp:105: 00010000:00010000:2.0:1783141967.272968:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.272981:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b200/0x279ffa91da899c97 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273024:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273042:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273056:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273068:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273094:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273101:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273108:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7a600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141967.273117:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273126:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141967.273137:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492777856 00010000:00010000:2.0:1783141967.273139:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:2.0:1783141967.273142:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783141967.273145:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492777856 00010000:00010000:2.0:1783141967.273146:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273151:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7a600/0x279ffa91da899d46 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273162:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273167:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273172:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273176:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b600 already unused, calling callback (ffffffffc217a4f0) 00010000:00010000:2.0:1783141967.273184:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273191:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.273199:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9464852b8c00) 00010000:00010000:2.0:1783141967.273201:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783141967.273204:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141967.273208:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00010000:00010000:2.0:1783141967.273210:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141967.273217:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94649e7c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+19:14425:x1869759492777856:12345-192.168.203.27@tcp:49:dd.0 00000100:00100000:2.0:1783141967.273533:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464971d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:336df830-3a74-41f7-9e23-8cb53be5699f+19:14426:x1869759492777600:12345-192.168.203.27@tcp:57:lhsmtool_posix.0 Request processed in 17934us (20390us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1783141967.273544:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000020:00080000:2.0:1783141967.273550:0:14123:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783141967.273633:0:14155:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783141967.273638:0:14155:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783141967.273668:0:14155:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783141967.273675:0:14155:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783141967.274930:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94649e7c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:336df830-3a74-41f7-9e23-8cb53be5699f+18:14425:x1869759492777856:12345-192.168.203.27@tcp:49:dd.0 Request processed in 1704us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141967.274945:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:1.0:1783141967.284623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141967.287989:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492778112 00000100:00100000:3.0:1783141967.288012:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492778112 00000100:00100000:3.0:1783141967.288186:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:3.0:1783141967.288200:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946482f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:336df830-3a74-41f7-9e23-8cb53be5699f+18:14426:x1869759492778112:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783141967.290432:0:14127:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783141967.290633:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1783141967.291084:0:14127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.293729:0:14127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.293766:0:14127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.293780:0:14127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.293817:0:14127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.293823:0:14127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.293858:0:14127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783141967.294034:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783141967.294043:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.294051:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141967.294060:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.294069:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.294099:0:14111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9464852b8a00) 00010000:00010000:1.0:1783141967.294102:0:14111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783141967.294108:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.294115:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9464bbd7b600/0x279ffa91da899d4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.294639:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141967.294643:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141967.294645:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783141967.294716:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946482f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:336df830-3a74-41f7-9e23-8cb53be5699f+20:14426:x1869759492778112:12345-192.168.203.27@tcp:35:lhsmtool_posix.0 Request processed in 6512us (10100us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1783141967.294741:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000020:00080000:2.0:1783141967.294750:0:14127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783141967.401212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141967.401287:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492778240 00000100:00100000:0.0:1783141967.401298:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492778240 00000100:00100000:0.0:1783141967.401368:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:0.0:1783141967.401380:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:336df830-3a74-41f7-9e23-8cb53be5699f+7:2366:x1869759492778240:12345-192.168.203.27@tcp:4:dd.0 00002000:00010000:0.0:1783141967.401441:0:14764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a48964e, atime: 0x6a48964d, ctime: 0x6a48964e, blocks: 0x1 00010000:00010000:0.0:1783141967.401452:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.401502:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1783141967.401506:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141967.401513:0:14764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.401529:0:14764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141967.406330:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.406510:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783141967.406523:0:14766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1783141967.406946:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492778368 00000100:00100000:2.0:1783141967.406957:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492778368 00000100:00100000:0.0:1783141967.407703:0:16259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:0.0:1783141967.407725:0:16259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946496b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:336df830-3a74-41f7-9e23-8cb53be5699f+9:2367:x1869759492778368:12345-192.168.203.27@tcp:4:dd.0 00010000:00010000:0.0:1783141967.407777:0:16259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.407798:0:16259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141967.407802:0:16259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783141967.407809:0:16259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783141967.407825:0:16259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.410057:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.410134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141967.410237:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1783141967.410292:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1783141967.414131:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141967.416474:0:14766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1783141967.418553:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492778496 00000100:00100000:1.0:1783141967.418614:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492778496 00000100:00100000:1.0:1783141967.418879:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1783141967.418891:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492778624 00000100:00100000:1.0:1783141967.418895:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492778624 00000100:00100000:1.0:1783141967.419900:0:16260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 2 00000100:00100000:1.0:1783141967.419918:0:16260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:336df830-3a74-41f7-9e23-8cb53be5699f+12:2366:x1869759492778496:12345-192.168.203.27@tcp:4:dd.0 00010000:00010000:1.0:1783141967.419972:0:16260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.419993:0:16260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141967.419998:0:16260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141967.420006:0:16260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.420037:0:16260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.420959:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1783141967.421746:0:16261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:2.0:1783141967.421765:0:16261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946485190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:336df830-3a74-41f7-9e23-8cb53be5699f+12:2367:x1869759492778624:12345-192.168.203.27@tcp:4:dd.0 00010000:00010000:2.0:1783141967.421811:0:16261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.421831:0:16261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.421836:0:16261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.421844:0:16261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.421872:0:16261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141967.424207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141967.424247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1783141967.424374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141967.424492:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:1.0:1783141967.424508:0:14766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:2.0:1783141967.425664:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:2.0:1783141967.425681:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492778752 00000100:00100000:2.0:1783141967.425695:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492778752 00000100:00100000:2.0:1783141967.425762:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:2.0:1783141967.425768:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492778880 00000100:00100000:2.0:1783141967.425771:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492778880 00000100:00100000:2.0:1783141967.425786:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:2.0:1783141967.425791:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492779008 00000100:00100000:2.0:1783141967.425794:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492779008 00000100:00100000:2.0:1783141967.425807:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:2.0:1783141967.425812:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492779136 00000100:00100000:2.0:1783141967.425815:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492779136 00000100:00100000:1.0:1783141967.430076:0:16262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:1.0:1783141967.430100:0:16262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:336df830-3a74-41f7-9e23-8cb53be5699f+18:2367:x1869759492778752:12345-192.168.203.27@tcp:4:dd.0 00010000:00010000:1.0:1783141967.430156:0:16262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.430178:0:16262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141967.430183:0:16262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783141967.430192:0:16262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.430209:0:16262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783141967.497050:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1783141967.497070:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1783141967.497079:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1783141967.566888:0:16259:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:2.0:1783141967.566900:0:16259:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783141966 -> 1783141967 00002000:00010000:2.0:1783141967.566904:0:16259:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783141966 -> 1783141967 00002000:00010000:2.0:1783141967.566907:0:16259:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1783141967.566927:0:16259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.566942:0:16259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.566952:0:16259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.566967:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.566986:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.567142:0:14764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.568284:0:16259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d6800 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141967.568296:0:16259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.568313:0:16259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.568493:0:14764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94649d0d7600 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141967.568499:0:14764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.568510:0:14764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.568528:0:14764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.568537:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e6c6fd/0x279ffa91da899d54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.568636:0:16259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.568646:0:16259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cae52f14/0x279ffa91da899d5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141967.568770:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:336df830-3a74-41f7-9e23-8cb53be5699f+25:2366:x1869759492778240:12345-192.168.203.27@tcp:4:dd.0 Request processed in 167382us (167558us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1783141967.568770:0:16259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946496b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:336df830-3a74-41f7-9e23-8cb53be5699f+25:2367:x1869759492778368:12345-192.168.203.27@tcp:4:dd.0 Request processed in 161040us (162444us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783141967.568790:0:16259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 1 00000100:00100000:3.0:1783141967.568812:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 0 00000100:00100000:2.0:1783141967.568843:0:16259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 5 00000100:00100000:3.0:1783141967.568855:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 6 00000100:00100000:2.0:1783141967.568861:0:16259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:336df830-3a74-41f7-9e23-8cb53be5699f+23:2367:x1869759492778880:12345-192.168.203.27@tcp:4:dd.0 00000100:00100000:3.0:1783141967.568870:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:336df830-3a74-41f7-9e23-8cb53be5699f+23:2367:x1869759492779008:12345-192.168.203.27@tcp:4:dd.0 00010000:00010000:3.0:1783141967.568909:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.568909:0:16259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.568929:0:16259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.568934:0:16259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.568941:0:16259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.568969:0:16259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.569207:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141967.569211:0:14764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783141967.569216:0:14764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.569226:0:14764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141967.570512:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1783141967.570543:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000100:00100000:3.0:1783141967.582747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141967.582796:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1783141967.582802:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492779392 00000100:00100000:2.0:1783141967.582816:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492779392 00000100:00100000:3.0:1783141967.582821:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141967.582856:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1783141967.582885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1783141967.583145:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492779264 00000100:00100000:1.0:1783141967.583151:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492779264 00000100:00100000:1.0:1783141967.583189:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:1.0:1783141967.583201:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946381369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:2366:x1869759492779264:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1783141967.583293:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946381369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1bce1679-fe1e-4e1b-8f40-0c055bbb8a76+13:2366:x1869759492779264:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 93us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783141967.583301:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 120 00000100:00100000:2.0:1783141967.583649:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492779648 00000100:00100000:2.0:1783141967.583655:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492779648 00000100:00100000:2.0:1783141967.583680:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492779776 00000100:00100000:2.0:1783141967.583684:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492779776 00000100:00100000:2.0:1783141967.583706:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:2.0:1783141967.583714:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:336df830-3a74-41f7-9e23-8cb53be5699f+5:2367:x1869759492779392:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141967.583763:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:336df830-3a74-41f7-9e23-8cb53be5699f+5:2367:x1869759492779392:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 50us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.583771:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 9 00000100:00100000:2.0:1783141967.583787:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:2.0:1783141967.583795:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:2367:x1869759492779648:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141967.583821:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:2367:x1869759492779648:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 28us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.583827:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 10 00000100:00100000:2.0:1783141967.583838:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00100000:2.0:1783141967.583844:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:2366:x1869759492779776:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141967.583870:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:caf0c8a4-b162-4255-923a-5fdfd2959d97+5:2366:x1869759492779776:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 26us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.583885:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 11 00000100:00080000:2.0:1783141967.583905:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783141967.583910:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783141967.585427:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869759492779520 00000100:00100000:2.0:1783141967.585441:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869759492779520 00000100:00100000:2.0:1783141967.585553:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00100000:2.0:1783141967.585565:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9464ba66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:2366:x1869759492779520:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1783141967.585679:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9464ba66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:caf0c8a4-b162-4255-923a-5fdfd2959d97+6:2366:x1869759492779520:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 116us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1783141967.585686:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 22 00000100:00080000:3.0:1783141967.586697:0:14118:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:2.0:1783141967.626818:0:16262:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:2.0:1783141967.626830:0:16262:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 10247 00010000:00010000:2.0:1783141967.626850:0:16262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.626866:0:16262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.626876:0:16262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.626884:0:16262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52c00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141967.626891:0:16262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.626901:0:16262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.626947:0:16262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.626956:0:16262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b27be8c7/0x279ffa91da899d70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.627075:0:16262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:336df830-3a74-41f7-9e23-8cb53be5699f+24:2367:x1869759492778752:12345-192.168.203.27@tcp:4:dd.0 Request processed in 196977us (212953us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1783141967.627089:0:16262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 4 00000100:00100000:2.0:1783141967.627136:0:16262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:2.0:1783141967.627150:0:16262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946497264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:336df830-3a74-41f7-9e23-8cb53be5699f+23:2367:x1869759492779136:12345-192.168.203.27@tcp:4:dd.0 00010000:00010000:2.0:1783141967.627188:0:16262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.627202:0:16262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.627206:0:16262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783141967.627214:0:16262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.627226:0:16262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783141967.627620:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:2.0:1783141967.627648:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1783141967.629683:0:16260:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1783141967.629710:0:16260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.629740:0:16260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.629749:0:16260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.629756:0:16260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946496f52400 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:3.0:1783141967.629761:0:16260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.629771:0:16260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.629797:0:16260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783141967.629806:0:16260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeb3b28e/0x279ffa91da899d62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783141967.629904:0:16260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:336df830-3a74-41f7-9e23-8cb53be5699f+17:2366:x1869759492778496:12345-192.168.203.27@tcp:4:dd.0 Request processed in 209984us (220004us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1783141967.629915:0:16260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 2 00002000:00010000:1.0:1783141967.636174:0:16261:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1783141967.636673:0:16261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.636690:0:16261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.636700:0:16261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.636707:0:16261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141967.636713:0:16261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.636725:0:16261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.636751:0:16261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.636759:0:16261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002261f887/0x279ffa91da899d69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783141967.641628:0:16261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946485190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:336df830-3a74-41f7-9e23-8cb53be5699f+15:2367:x1869759492778624:12345-192.168.203.27@tcp:4:dd.0 Request processed in 219855us (231478us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1783141967.641646:0:16261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000001:00080000:0.0:1783141967.667906:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1783141967.668630:0:16259:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:1.0:1783141967.668655:0:16259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.668672:0:16259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.668700:0:16259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.668710:0:16259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7b000 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141967.668716:0:16259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.668728:0:16259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.668755:0:16259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.668763:0:16259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004ac2a81/0x279ffa91da899d77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141967.668884:0:16259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:336df830-3a74-41f7-9e23-8cb53be5699f+11:2367:x1869759492778880:12345-192.168.203.27@tcp:4:dd.0 Request processed in 100024us (244684us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1783141967.668896:0:16259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 5 00002000:00010000:2.0:1783141967.673583:0:14764:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1783141967.673708:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.673726:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.673736:0:14764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.673751:0:14764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bfe17200 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:2.0:1783141967.673756:0:14764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.673766:0:14764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.673792:0:14764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783141967.673801:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052422452/0x279ffa91da899d7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783141967.673917:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:336df830-3a74-41f7-9e23-8cb53be5699f+9:2367:x1869759492779008:12345-192.168.203.27@tcp:4:dd.0 Request processed in 105044us (249661us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1783141967.673928:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 6 00010000:00010000:1.0:1783141967.710804:0:16262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.710824:0:16262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.710849:0:16262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.710857:0:16262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9464bbd7be00 already unused, calling callback (ffffffffc173ece0) 00010000:00010000:1.0:1783141967.710862:0:16262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.710871:0:16262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.710892:0:16262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783141967.710899:0:16262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bd768d5/0x279ffa91da899d85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783141967.710988:0:16262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946497264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:336df830-3a74-41f7-9e23-8cb53be5699f+7:2367:x1869759492779136:12345-192.168.203.27@tcp:4:dd.0 Request processed in 83838us (286609us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1783141967.710999:0:16262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000001:00080000:0.0:1783141967.711276:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:1.0:1783141967.770901:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783141968.794737:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783141968.797305:0:16301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1783141969.820686:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28814 lines, 28814 kept, 0 dropped, 0 bad.